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^ 1 Abstract 

On 



We consider the problem of testing equality of functions fj : [0, 1] — >• ffi for j = 
1, 2, . . . , J the basis of J independent samples from possibly different distributions under 
the assumption that the functions are monotone. We provide a uniform approach that 
covers testing equality of monotone regression curves, equality of monotone densities and 
equality of monotone hazards in the random censorship model. Two test statistics are 
proposed based on Li-distances. We show that both statistics are asymptotically normal 
and we provide bootstrap implementations, which are shown to have critical regions with 
asymptotic level a. 



1 Introduction 



A classical statistical problem is the fc-sample problem, where one has to decide whether dif- 
ferent samples can be regarded as coming from the same population. In the non-parametric 
setting, |41j and [42] introduced the first two-sample tests, one based on the distance between 
the empirical distribution functions of the two samples and one based on ranks. General- 
izations of these methods to the fc-sample problem, with k > 2, are given in |22j and [27], 
respectively. Although Wilcoxon-type tests remain very popular, they are known to be able 
to detect only a limited range of alternatives. To overcome this difficulty, several solutions 
have been proposed. For an overview and references on this topic, see [19], who developed a 
two-sample test inspired by the smooth Neymann test, in which the problem is reparametrized 
and modeled via some multivariate exponential family with an unknown parameter in such 
a way that the two-sample problem amounts to testing that this parameter is zero. Another 
recent approach consist of comparing empirical characteristic functions, e.g., see [17] . who 
extended the univariate two-sample tests from [10] and |33] to the multivariate A;-sample set- 
ting, k > 2. For procedures based on comparing kernel density estimators, see Anderson, 
Hall and Titterington [1], who consider the /^-distance in the multivariate two sample set- 
ting, and [32], who uses the L\- and the Loo-distance, and see [5] and references therein, for 
methods based on empirical likelihood. A generalization of the Smirnov test to the case of 
multivariate observations is considered in [H [36], among others. See also O [21 [21] for more 
references on multivariate fe-sample tests. The recent paper by [21] points out that most 
of the rank based tests proposed in the literature, unless one-sided, could be biased against 
alternatives of interest. In that paper, multivariate distribution free two-sample tests, based 
on the ranks of suitable distances of multivariate observations, are developed. Unbiasedness 
and power of those tests are studied against Lehmann alternatives. 

The /c-sample problem arises naturally in survival analysis, where the observations are 
typically right censored. Various two-sample tests inspired by the Wilcoxon test have been 
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proposed for right censored data, see [151 E01 SO] and references therein. Other approaches 
are based for instance on comparison of quantile estimators, see Li, Tiwari and Welles |31j . 

The fc-sample problem also arises in the regression setting. For instance, in medical studies 
one wishes to compare the mean response of a treatment group of subjects to that of a control 
group, taking into account a covariate such as the dose of drug. In such cases, one wishes 
to compare two or more regression curves. In this setting, p3] developed a two-sample test 
calibrated by the bootstrap. The test statistic, which is essentially a scaled version of an 
integrated L2-distance between smooth estimators of the regression curves (see also King, 
Hart and Wehrly [25]). is based on differences between the response variables at given values 
of the covariate. Another two-sample test based on these differences, which in spirit resembles 
the Kolmogorov-Smirnov statistic, is proposed in [7j. In the case where the covariate values as 
well as the sample size possibly differ in the two considered samples, [28] developed a test based 
on quasi-residuals. In this setting with possibly heteroscedastic errors, [34] consider a test 
based on the estimation of the L2-distance between the two regression curves and generalized 
the method to the case of fe-samples, k > 2, whereas [35] developed a test calibrated by the 
bootstrap, which is based on the difference of two marked empirical processes. Most of the 
aforementioned procedures involve the choice of a tuning parameter. 

Nonpar ametric methods for /c-sample problems under shape constraints are quite limited. 
|12j considers likelihood ratio type two-sample tests in the current status model, which is 
closely related to other shape constrained nonparametric models. The test statistics are shown 
to be asymptotically normal under the null hypothesis of equal distributions and the test is 
calibrated using the bootstrap. The problem of comparing two monotone fractile regression 
functions, which is similar in spirit to the problem of comparing two monotone regression 
functions, is considered by [39J. A test based on the L2-distancc between two monotone 
estimators is discussed. The test is calibrated by the bootstrap, but no limit distribution is 
provided. 

The above mentioned testing problems have one common feature, i.e., they essentially test 
the equality of two or more functions in various sorts of statistical models, e.g., distribution 
functions, densities, characteristic functions, hazard rates, or regression curves. In this paper 
we consider the following testing problem 



subject to the constraint that fj : [0,1] ^ R is decreasing for all j = 1,2,..., J. This 
general framework includes a A;-sample test for samples from a decreasing density and a test 
for equality of decreasing regression curves or decreasing hazard rates. We propose two test 
statistics based on Li-distances between non-parametric Grenander-type estimators f n ~. The 
first one compares mutual distances between the different individual estimators 



The second one compares the distances between each individual f n j and a pooled estimator f n Q 
for the mutual /o under the null hypothesis: 



Hq : f\ — fi 



fj against H 1 :f i ^ fj for some i / j 




(1) 
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We show that both test statistics are asymptotically normal and propose a bootstrap proce- 
dure to calibrate the test. Finally, we discuss the special cases of testing equality of monotone 
regression functions, monotone densities and monotone hazards rates under random censor- 
ship, and show in each of these cases that the bootstrap works. 

In Section [5] we describe the general setup, state our main results, and discuss the differ- 
ences between the approach in this paper and the ones used in Groeneboom, Hooghiemstra 
and Lopuhaa |13j . [29] and [9] to prove similar results. In Section [3] we discuss the implemen- 
tation of the test and show that the bootstrap works in the previous mentioned statistical 
models. All proofs are postponed to an appendix at the end of the paper. 



2 Main results 

For estimating the functions fj : [0, 1] 



we suppose that for each j = 1, 2, . . . , J, 



fj(x) dx 



(3) 



is well defined and that we have an estimator F n j at hand based on rij observations. We 
denote by n = ^ ■ rij the total number of observations and for notational convenience (and 
possibly arguing along subsequences), we assume that rij = Cj ■ n where Cj > does not 
depend on n. Thus, "Ylj c j = 1- Denote fo and Fq for the corresponding quantities under the 
null hypothesis, where we estimate Fq by 

J 

F n0 = ^2cjF nj . (4) 

3=1 

Then, for all j = 0, 1 . . . , J, we define f n j as the left-hand slope of the least concave majorant 
of F n j, with /nj(0) = lim^o fnj(t)- We will frequently make use of results from [13] and [9]. 
Similar to these papers, we will work under the following assumptions: 

(AO) The estimators F n \, F n 2, ■ ■ ■ , F n j are independent and for every j = 1,2,..., J, the 
estimator F n j : [0, 1] — > R is a cadlag step process. 

(Al) For each j = 1,2, . . . , J, the function fj : [0,1] i— > R is decreasing and continuously 
differentiable, such that < inf tg [ ,i] \fj(t)\ < sup tg [ 0j i] < °°- 

(A2) For each j = 1, 2, . . . , J, there exists a constant Cj > 0, such that for all x > and 



t = 0, 1, the process M n j 
E 



F, 



Fj satisfies 



sup (M nj (t) 

u£[0,l], x/2<\t-u\<x 



M nj (u)Y 



< 



C jX 



n , 



Futhermore, we assume that there exists an embedding either into Brownian motion or into 
Brownian bridge. 

(A3) For each j = 1, 2, . . . , J, there exists a Brownian motion or Brownian bridge B n j, an 
increasing function Lj : [0, 1] i— >■ R with inft L'j(t) > 0, and constants q > 6 and C > 0, 
such that for all x G (0, rij]: 



to ) 

ir <n- sup 

*e[0,i] 



M nj (t) 



n 



-1/2 



B nj o Lj(t) 



> x } < Cx~ q . 
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It should be noticed that, since the F n j are assumed to be independent, we can assume 
without loss of generality that the B n j are independent. Note that, for j = 1, 2, . . . , J, we 
can write 

B nj (t) = W n , (i) - Cnjt, for t € [0, 1], (5) 

where the W n j are independent Brownian motions and £ n j = 0, if B n j is Brownian motion, 
and £ n j ~ ^(0,1) independent of B n j, if B n j is Brownian bridge. Finally, we require the 
following smoothness assumption. 

(A4) There exist an a 6 (3/4, 1] and C > 0, such that for all x, y £ [0, 1] and j = 1, 2, . . . , J, 
\f'j{x) - < C\x - y\ a and \L'j(x) - L'j(y)\ < C\x - y\ a . 

These are the usual assumptions when studying the L p -error of isotonic estimators. It is 
explained in [9] that several classical models are covered by the above general framework. 
As an example we mention the model where one observes J independent samples where the 
random variables in the jth sample have a decreasing smooth density function fj. In this 
example, F n j is the empirical distribution function based on the jth. sample and Lj = Fj. 
This example will be studied in detail in Section [3.31 Two other examples, where fj is either 
a regression function or a failure rate, are studied in Sections 13.21 and 13.41 

Our main result is that under the above assumptions both test statistics defined in (pQ) 
and d2|) are asymptotically Gaussian under the null hypothesis. In order to formulate these 
results more precisely, we introduce the random variables 

Cj(c) = argmax (W^ti + c) - u 2 } , j = l,2, . . . , J, (6) 

where the argmax function is the supremum of the times at which the maximum is attained, 
Wi, W2, • • • , Wj are independent standard two-sided Brownian motions. We are now in the 
position to establish asymptotic normality for test statistic S n \. 

Theorem 1 Assume (AO), (Al), (A2), (A3), (A4) and let S n \ be defined by ((TJ). Let Q be de- 
fined in Q, for j = 1, 2, . . . , J , with independent standard Brownian motions W±, W2, ■ ■ ■ , Wj. 
If f = fx = fi = ■ ■ ■ = fj, then ?i 1 / 6 (n 1 / 3 5 n i — mi) converges in distribution, as n — > 00, to 
the Gaussian law with mean zero and variance o~\, where 



with 




for j = 1,2,..., J. 



4 



In the special case where all Lj = L are the same, after change of variables u = tfL(s) 1 ^ 3 , we 
find 



0- 



8/ L\ S )ds^Yl 



i<j l<m 



COV 



Cite 



V3„ 



0(c 1/3 



u 



.1/3 



1/3 



0(0) 0(0) 



,1/3 



,1/3 



du 



mi = / |4/ / (s)L / (s)| 1 / 3 ds^E 



Kj 



cm c,(o) 



c- 



1/3 



1/3 
°3 



This resembles the normalizing constants in Theorem 2 in [9] for the case p = 1. An example 
is the monotone density model, where under the null hypothesis L'- = fj = f, in which 
case mi and <rf coincide with the normalizing constants in Theorem 1.1 in |13j . In particular, 
the limiting variance a\ does not depend on the underlying density /. Another example is the 
monotone regression model, where Lj(t) = trj, with rj being the variance of the measurement 
error. When all the error variances are the same, mi and a\ coincide with the normalizing 
constants in Theorem 2 in [8]. 

To establish a similar result for S n 2 is more complex, due to the fact that we have to 
deal with differences between a marginal estimator f n i and the pooled estimator f n o, which 
are both (partly) build from the same ith sample. First of all, we need that, under the null 
hypothesis /o = /i = • • • = fj, the above assumptions also hold to some extent for j = 0. 
Clearly, assumption (AO) then becomes irrelevant and (Al) is immediate, as well as the first 
part of (A4). Because, under the null hypothesis, 



J J 
M n0 (t) = F n0 {t) - F (t) = ^2 Cj {F nj {t) - Fj(t)) = Y,CjM nj {t), 

3=1 3=1 



the inequality (Jensen) 



(ai + ■ ■ ■ + a k ) 2 < k{a\ + ■ ■ ■ + a 2 k ) 



(8) 



0) 



yields that also (A2) holds for j = 0. The remaining assumptions require the definitions 
of Lq and B h q. To have (A3) for j = 0, we need to show that M n Q can be approximated 
by n~ l / 2 B n Q o Lq, for a given increasing function Lq : [0, 1] — > M with inf tg r 0j i] L f (t) > and a 
Gaussian process B n Q. From relation ([8]) and assumption (A3), for j = 1, 2, . . . , J, it follows 
that we then must have 

J 

Bno{t) = Y c/ 2 B nj o Lj o L \t). (10) 

3=1 

Furthermore, when B n j = W n j, for j = 1, 2, . . . , J in (A3), then 



B n0 O Lo(t) = Yl C ) /2W nj Ht) =^1^2 CjHt) , 
3=1 " \3=1 J 

where W denotes Brownian motion. Hence, using the monotonicity of Lj, for j = 0, 1, . . . , J, 
from comparing the covariance functions, it follows that we must have 



3=1 



(11) 
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This Lq is increasing such that inf t6 [ 0j i] L'^t) > and the second part of (A4) for j = follows 
immediately from the one for j = 1, 2, . . . , n. Note that, in contrast to B n j, for j = 1, 2, . . . , J, 
the process B n Q is not necessarily a Brownian motion or a Brownian bridge. However, we do 
have the following version of condition (A3). 



Lemma 1 Assume (A3) and suppose fo = fx = ■ ■ ■ = fj- Let B n Q and Lq be defined by (fTUj) 
and (fTTj) . and let M n Q = F n Q — Fq, where F n Q is defined in (j4]). Then, there exists C > 0, 
such that for all x G (0, n]: 



Pln 1 " 1 ^ sup 
I te[o,i] 



M nQ (t) - n-^B^ o L (t) > x \ < Cx~ q . (12) 



Now that we have established assumptions (A0)-(A4) for the pooled estimator, we proceed 
by introducing a suitable variable, such as the one defined in for the case j = 0. However, 
this case is more complex and we have to distinguish between two of them. First, for each 
fixed t £ [0, 1], define 



Cto(c) = argmax \ W t0 (u + c) - u 2 \ , 
Cto(e) = argmax \ W t0 (u + c) - u 2 \ , 



(13) 



where 



_ J f Cj L'At)\ 112 

j 

W t0 (u) = £ c^V,- (n 1 ^ | L . o L" ^LoC*) + n- 1/3 u) - !,-(*)}) 



(14) 



with Wi, W2, ■ ■ ■ , Wj being the independent standard Brownian motions used to define ^ 
and Lq defined in (fTT|) . Note that for t £ [0, 1] fixed, due to (fTT|) . the processes W^o and W^o 
are distributed as standard Brownian motion, which means that Cto( c ) an d Cto( c ) have the 
same distribution as Cj( c )- We are now in the position to formulate our second main theorem. 



Theorem 2 Assume (AO), (Al), (A2), (A3), (A4) and let S n2 be defined by ©. Let Q, 
Cto and Cto be defined in ([6]) and (|13p . respectively, with independent standard Brownian 
motions W±, W2, • • • , Wj. Lf f = f\ = /2 = ■ ■ ■ = fj, then n 1 / 6 (n 1 / 3 S' n 2 — m n 2) converges in 
distribution, as n — > 00, to the Gaussian law with mean zero and variance a\, where 

J J pl poo 

a * = 8 E E / / cov(\Y si (t)-Y s0 (t)\,\Y SJ (0)-Y s0 (0)\) dtds, 
i=lj=1 Jo Jo 

with Y s j defined in ([7]) and 

Y s0 (t) = L' (s) 1/3 C*o (77^73) • (15) 
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Furthermore, 



J rl 



3=1 



™2 = E / (4|/'(t)l) 1/3 E 



o 



4(*) 1/3 C»(0) - ^TT^O(O) 



1/3 
C 3 



di. 



// in addition, Lj = ajL, for all j = 1, 2, . . . , J, for a given function L : [0, 1] — > R and given 
real numbers Oj, then (to = CiO m 2 no longer depends on n. 

The difference between the limiting bias mi and E(?i 1 / 3 5 n 2) will be shown to be of the 
order o(re _1//6 ). Although Cto(0) can be approximated further by Cto(0), this approximation 
is not sufficiently strong to cancel the factor n 1 / 6 . This difficulty does not play a role for 
var(n 1 / 3 5 n 2), for which we only need a consistent approximation. For this reason the limiting 
bias m2 may still depend on n, whereas the limiting variance o~\ is independent of n. Only in 
specific cases, such as Lj = ajL, the limiting bias will also not depend on n. Examples are the 
monotone density model, where under the null hypothesis Lj = fj = f, and the monotone 
regression model, where Lj(t) = trj. 

The explicit expressions for the normalizing constants in Theorems [Hand [2] are intractable 
for the purpose of building a statistical test because they depend on the fj's and the Lj's 
in a complicated manner. Therefore, in order to implement our statistical test, we prefer to 
approximate the limit distribution of our test statistics using bootstrap methods, as described 
in the following section. 

Before doing so, we believe it is useful to give the main line of reasoning used to prove 
Theorems Q] and [2] and explain the main differences with the type of argument used to prove 
similar results in [13], [29] and [9]. When we define 

J 

W n0 (t) = ^cVVnj-oLj-oLo 1 ^), (16) 

3=1 
J 

U(t) = Y, c ) l2 ^hoL^ l {t), (17) 

3=1 

with B n o and Lq defined by (fTUj) and (fTT|) . respectively, then similar to ([5]), also B n o(t) = 
W n o(t) — £no(t), where the process W n o(t) is a standard Brownian motion and £ n o is indepen- 
dent of B n Q. For every j = 0, 1, . . . , J, define 

F n j{t) = F n j{t), 

Fnj(t) = n- l/2 B nj {L (t)) + Fj{t), (18) 

_ -1/2 



F™(t)=n-^W n j(Lj(t)) + Fj(t). 



and for S = E, B, W 



J 

F^{t) = Y J C j F^{t). (19) 

3=1 

Obviously, F^- is the estimator for ([3|) or (J4j) and, although F®- and F^ are not estimators 
in the sense that they are built from observations, we can define the corresponding slope 
processes 

fnj(t) = teft slope of the least concave majorant (LCM) of F^j{u) at u = t, (20) 
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for j = 0, 1,... , J and 5 = E,B,W. When investigating the asymptotic behavior of 
one typically exploits the fact that can be approximated by F^ , using (A3) and (fT8|) . 
However, if two processes are uniformly close, then the slopes of the concave majorants of both 
processes are not necessarily uniformly close. For this reason, we introduce the (generalized) 
inverse of defined for o £ M by U^(a) = sup{i G [0, 1] : f^j(t) > a}, with the convention 
that the supremum of an empty set is zero. It is fairly easy to see that 



for a > 0, and that 



U% (a) = argmax { F% (t) - at} , (21) 
te[o,i] 

f^(t) < a if and only if U^(a) < t. (22) 

This means U^j is closely connected to f^, but its asymptotic behavior is more tractable 
because if two processes are close, then also the locations of their maxima are close. For this 
reason, the approach used in [13], [29] and [9], which is originally due to Groeneboom |llj . 
is to switch from L p -errors in terms of to L p -errors in terms of U^. The next lemma 
provides such an approximation suitable for our purposes. For S = E, this result is similar 
to Corollary 2.1 in [13], Lemma 2.1 in |29] and equality (21) in [9]. For later purposes, e.g, 
see (124ft . we also establish the approximation for the cases S = B, W. 



Lemma 2 Assume (Al), (A2), (A3), and suppose f = f\ = ■ ■ ■ = fj. Then for i,j = 
0,1,..., J and S = E,B,W, 

n 1/3 / \f%i(t) - dt = n 1 / 3 / \Ug(a) - U^(a)\ da + o p (n^ 6 ). (23) 

Jo Jf(i) 

Proceeding in the spirit of [13], [29] and [9], the next step would be to replace on the right 
hand side of (|23p by U^j. In statistical models where (A3) holds with B n j being Brownian 
motion, e.g., the regression model and the random censoring model, this can be done by means 
of Lemma 5 in [9]. However, in statistical models, where B n j is Brownian bridge rather than 
Brownian motion, e.g., the density model, this is no longer possible. In such models, the 
approximation of by is relatively easy, due to assumption (A3). This assumption will 

ensure that F^ — F^ is of order smaller than n~ 5//6 , which in turn guarantees that — 
will be sufficiently small. 

Lemma 3 Assume (Al), (A3), (A4) and suppose f = fi = ■ ■ ■ = fj- Then, for each 
j = 0,1,2,..., J, 

n 1/3 / \U%(a) - U*(a)\ da = o p {n~^). 
JfW 



This result is similar to Corollary 3.1 in [13] for the density model, but is now extended to 
our general setup. However, it is not possible to establish a similar result for and , 
because F^ — F^ is of order n -1 / 2 , which is too large. This difficulty is solved in [13], [29] 
and [9], by subtle use of relationship ([5]). These approaches apply to the L p -error in terms of 
a single inverse U^, but they do not extend to our current situation, because the right hand 
side of (j23|) involves the Li-error between two different inverses and U^j- 

For our current setup, we solve this problem by returning to the slopes themselves. 
Whereas closeness of F^- and F^- is not sufficient to obtain suitable bounds on f^- — f^-, the 
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situation is different for and -FiT. The reason is that the difference between Brownian 
bridge B n j and Brownian motion W n « is only a straight line. We can then obtain the following 
the slope equivalent of Corollary 3.3 in 



Lemma 4 Assume (A2), (A3). Then, for i,j = 0,l,...,J, 

n 1/3 I' \f*M - f%(t)\ dt = n 1 / 3 I' \f%(t) - f%(t)\ dt + o p {n- l l% 



After having established Lemmas [21 [3] and [U in order to prove Theorems [T] and ([2]) , we will 
use the following line of reasoning: 



n 



1/3 / iffiW - Xj(t)| dt = nV3 / \uE(a) - U*(a)\ da + o p ( n -^) 
o Jf(i) 

= nV3 / \u*(a) - U*(a)\ da + o p (n- 1 ^) 

1/3 ! l \m{t)-B(t)\dt + o p {n-^) (24) 



n 



(i 



™ 1/3 / \f%(t)-f%(t)\dt + o p (n- 1 / 6 ) 



= nV3 / pw {a) _ f)W {a)l da + Q (n -i/ 8)j 
■//(i) 

where f = fi = ■ ■ ■ = fj- Of course, in models where -B n j is Brownian motion, then 
= C/^, so that Lemma [3 becomes irrelevant, and we can obtain 

Jo Jfd) , 

r/(o) ^ ^ ( j 

= nV3 / |0W( O ) _ ^( a) | da + 0p (n-V6), 

immediately, either using Lemma 5 in [9] or as a special case of Lemma [3j Once the test 
statistics ([T|) and ([2]) can be expressed in terms of integrals 

rf(o) 

n 1/3 / \U%(a)-U%(a)\da, 
JfO) 

the proof of asymptotic normality follows the same line of reasoning as used in [13], [29] 
and [3], using the independent increments property of Brownian motion. 



3 Implementation of the test 

This section is devoted to the implementation of the test in the three different models that 
are covered by the general setup. Because the limit distribution of the test statistic under 
the null hypothesis is intractable, we use a bootstrap procedure to calibrate the test. It is 
known that the standard bootstrap typically does not work for Grenander-type estimators, 
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e.g., see |26| 138] . so we consider here a smoothed Bootstrap. This will require the use of a 
smooth estimator f n which, under the null hypothesis /i = • • • = /j = /o, satisfies bootstrap 
versions of assumptions (A0)-(A4). The following general property will be sufficient for our 
purposes. 

(A*) The estimator /„ is continuously differentiable on [0,1]. Furthermore, there exists an 
event A n and real numbers a G (3/4, 1] and e n > 0, such that ~P(A n ) — > 1 and n 7 e n — > oo 
for any 7 > 0, as n — > 00, and such that the following two properties hold on A n : 



sup \f {t) 
te[o,i] 



fn(t)\ < n 2-+s /e n 



and for all x, y £ [0, 1], 



\J' n {x)-J' n {y)\<\x-y\<*/e n . 



(26) 



(27) 



Condition (|27|) ensures part of the bootstrap version of assumption ( A4) , although it is slightly 
stronger. The factor l/e n has been added, since it is difficult to construct an estimator 
that satisfies (A4) exactly. However, for our purposes, assumption (I27p will have the same 
effect as assumption (A4), because n 7 e n — > 00 for all 7 > (typically one should think 
of e n = 1/logn). Condition (I26p comes naturally from minimax rates considerations for 
kernel density estimators, in situations where the underlying density satisfies (A4). Bootstrap 
versions of (AO), (A2), (A3), and the second part of (A4) require the definitions of estimators 
for Fj and Lj. This will be taken care off in Sections 13.21 13.31 and 13.41 for the three different 
models that are covered by the general setup. The bootstrap version of assumption (Al) 
is satisfied by any estimator f n that satisfies (A*), with probability tending to one. More 
precisely we have the following general lemma. 

Lemma 5 Assume (Al) and let f n : [0,1] H> 1 k an estimator that satisfies (A*) with 
/o = /1 = • • • = fj. Then there exist positive numbers Cq,C\ and an event B n , such that 
P(.B n ) —7-1, as n — > 00, and on B n , the function f n is decreasing with 



sup \f n (t) 
te[o,i] 



/o(t)|=o(n" 1/3 ), 



and 



sup \f n {t)-m\=o{n-y% 

te[o,i] 



C < mf\fUt)\ < sup |/;(t)|<Ci. 
<e[o,i] te[o,i] 



(28) 
(29) 

(30) 



By means of an estimator f n , we aim to build bootstrap versions S* k of test statistics S 1 , 



for k = 1,2, in such a way that under the null hypothesis and conditionally on the original 
observations, n 1 / 6 (S'* fc — m*.) converges in distribution to the Gaussian law with mean zero 
k , in probability, i.e., 



n 

and variance a 2 



sup 



n 



< t 



*(t) 



0, in probability, as n — > 00, 



(31) 



where m k and a\ are the limit bias and variance given in Theorems Q] and [21 denotes the 
distribution function of the standard Gaussian law, and P* is the conditional probability 
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given the original observations. In this case, for a fixed level a £ (0, 1), one can compute (or 
merely approximate thanks to Monte-Carlo simulations) the a- upper percentile point q^ki ) 
of the conditional distribution of <S* fc and consider the critical region 

{S nk > q nk (a)} . (32) 

If assumptions (A0)-(A4) are fulfilled, then Theorems [T] and [2] together with f)31 1) ensures 
that the test with critical region (j32p has asymptotic level a. 

Below, we will provide an estimator f n satisfying (A*) under the null hypothesis in the 
general framework of Section [2j Subsequently, we provide, in the three different models that 
are covered by this general framework, a construction of «S* fc that ensures that the test with 
critical region ([32]) has asymptotic level a. Note that the estimator in Section [331 can be used 
in all of these three models. 



3.1 An estimator for f 

For simplicity, we assume here that under the null hypothesis, the function fo = fi = • • • = fj 
is twice continuously differentiable. We consider a sequence of positive real numbers h n of the 
order n -1 / 5 and a kernel function K : R — > R supported on [—1, 1], which symmetric around 
zero and three times continuously differentiable on R, such that f K(t)dt = 1. Based on h n 
and K, we define /„ as the first derivative of the following smooth version of F n Q. For every 
t £ [h n , 1 — h n ], define 

Fn{t) = [ F n0 (x)K (^*) dx, (33) 



h n Jr \ h n 

for every t £ [0, h n ], define 

F n (t) = F n (h n ) + (t- h n )J n {h n ) + \f' n (h n )(t - h n ) 2 + \{t - KffZiK), (34) 

2 O 

and for every i € [1 — h n , 1], define 

F n (t) = F n (u n ) + (t- u n )f n (u n ) + -J' n {u n ){t - u n ) 2 + -{t - UnffliUn), (35) 

2 D 

where u n = 1 — h n . Note that for t £ [h n , 1 — h n ] : 

f n (t) = K(t) = ± I F n0 (x)K> ( t —^) dx = 1- I K ( t —^) dF n0 (x), 

so that fn is a kernel type estimator, modified at the boundaries in such a way that for 
I = 0, 1, 2, the derivative /n ^ properly estimates the derivative /® on the whole interval [0, 1], 
whereas the simple kernel estimator may show difficulties at the boundaries. The following 
lemma guarantees that this f n satisfies condition (A*). 

Lemma 6 For t £ [0,1], let j n {t) = F' n {t), where F n is defined by ([33]), §M§ and ([3"5]). 
If fo = fx = • • • = fj is twice continuously differentiable on [0, 1] and (A3) holds with 
sup 4e [ 01 ] Lj(t) < oo, for each j = 1, 2, . . . , J, then f n satisfies (A* ). 

We end this section, by discussing possible estimators F n j in the three models that are covered 
by our setup. Furthermore, for these models, we propose bootstrap versions of our test 
statistic for which we show that the test with critical region (|32p has asymptotic level a. It 
suffices to specify bootstrap versions F*j, for j = 1,2,... , J. Consequently, F* is defined 
similar to ([3]), and for k = 1,2, bootstrap versions are defined similar to ([1]) and ([2]), 
with /*• being the left-hand slope of the least concave major ant of F*-. 
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3.2 Monotone regression function 

For each j = 1, 2, . . . , J, we have observations Yjj, for i = 1, 2, . . . , rtj, satisfying 

= fj^Xij) + e^j, (36) 

where ccy = i/rij and E(ejj) = 0. The e^-'s are independent and for each j = 1, 2, . . . , J, the 
variables e^, i = 1, 2, . . . , rij, have the same distribution with a finite variance r? > 0. In this 
case, Lj(t) = trj for j = 1, 2, . . . , J (see also Theorem 5 in [9]) and the estimator for Fj is 

Tlj 

F ni(-t) = — E V ' ^ *> = ^ E ( 37 ) 

J i=l J i<rijt 

To define the bootstrap version of the test statistic, we first define ei,- = Yy — f n (xij) and 




for j = 1, 2, ... , J and i = 1, 2, . . . , rij. Then, conditionally on the original observations Y^, 
we define independent random variables e|_- as follows. For j = 1, 2, . . . , J fixed, each random 
variable e*j is uniformly distributed on {e m j, m = 1, 2, . . . , rij}. Finally we set 

Y^j = fn(Xij) + 

for j = 1, 2, . . . , J and z = 1,2,..., rij. For j = 0, 1, . . . , J, we define bootstrap versions F*j 
in the same manner as F n j in (|37h and ((4|), just by replacing by Y^*. 

Theorem 3 Suppose maxi<,< j E,\eij\ q < oo, for some q > 6, and that (Al) and (A4) hold 
with Lj{t) = trj. Let f n be an estimator that satisfies (A* ) with fo = fx = ■ ■ ■ = fj, then for 
k = 1,2, the test with critical region A32\) has asymptotic level a. 

Note that the theorem holds for any estimator satisfying (A*), in particular for the esti- 
mator /„ proposed in Section l3~H with F n o defined through (|37|) and (j4|). Also note that, 
although it is tempting to consider the pooled estimator f n = / n o, since it does not depend 
on any tuning parameter, this estimator does not satisfy (A*). We conjecture that with this 
choice of f n , the bootstrap calibration does not work and encounters similar difficulties as 
in \26\ [38] . This estimator was used in [39] , but no theoretical result was provided for the 
proposed two-sample test for monotone fractile regression functions, and we suspect that the 
proposed bootstrap does not always work and that a smoothed bootstrap is needed. 

3.3 Monotone density 

For each j = 1,2,...,J, we have independent observations Xij, for i = 1, 2, . . . , rij, with 
density fj. The J samples are assumed to be independent. The estimator for Fj in this case 
is the empirical distribution function 

F nj (t) = —J2l{X lj <t}. (38) 
n i i=i 
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Let f n be an estimator for fo = fi = ■ ■ ■ = fj- One possibility is the kernel density estimator 
from Section [370 Another possibility is to use the least concave majorant F n Q of F n Q instead 
of F n Q. It follows that for I = 0, 1, 



i 



h 2+l 
1 



ul+l 

1 



(F n0 (x)-F n0 (x))K^ 



t — x 



d.r 



(F n0 (t - uh n ) - F n0 (t - uh n ))K^ l+l \u) du 



C-^ sup \F n0 (s) - F n0 (s)\TV(K^) 
h n se[o,i] 



o(n~ 2 / 3 logn)/i- (i+1) , 



a.s., 



according to [23], where TV(iC^ +1 ^) < oo denotes the total variation of K^ l+1 \ This implies 
that if f n satisfies the properties of Lemma El then also does f n . To define the bootstrap 
versions of F n j, conditionally on the original observations Xy, we define independent random 
variables X*-, j = 1, 2, . . . , J, i = 1, 2, . . . , rij, with the same density f n . Then we define F 1 
in the same manner as F n j, just replacing Xy by X*- in ([38]) . 



"j 



Theorem 4 Suppose that (Al) and (A4) hold with L'- = fj and that inf tg [ 0) i] fj(t) > /or 

each j = 1, 2, . . . , J. Lei / n 6e an estimator that satisfies (A*) with /o = /i = • • • = /j, f/ien 
/or A; = 1,2, t/ie test wit/i critical region fggj) /ias asymptotic level a. 



3.4 Random censorship with monotone hazard 



For each j 
where X,,- 



1, 2, . . . , J, we have right-censored observations (Xj, Ay), for i = 1, 2, . . . , rij, 



and Ajj = < Yij}. For each j = 1,2,...,J, the failure 



times Tij are assumed to be nonnegative independent with density gj and to be independent 
of the i.i.d. censoring times that have distribution function Hj. The J samples are assumed 



to be independent. The parameters of interest are the failure rates fj = gj/(l 
where 



Gj) on [0,1], 



Gj(t) 



\ 9j(x) dx = 1 - exp (-Fj(x)) . 
Jo 



The estimator for the cumulative hazard Fj is defined via the Nelson-Aalen estimator N n j 
as follows: let t\j < ■ ■ ■ < t m j denote the ordered distinct uncensored failure times in the 



jth sample and n^j the number of i G {1, 2, . . . , rij} with Xy 
on [tij,t i+ ij) with 



> 



tkj, then N n j is constant 



X n j (ty) 



fe<« J 



(39) 



and N n j(t) 



for all £ < and N n j(t) = N n j(t m j) for all t > t 



The estimator 



is the restriction of N n j to [0, 1]. Finally, as an estimator for the distribution function H 



we take the Kaplan-Meier estimator H n j based on the jth sample. Let f n be an estimator 
for /o = /i = • • • = fj. To define a bootstrap version of F n j, conditionally on the original 
observations, we first define independent random variables T*- and Y£, for j = 1, 2, . . . , J and 

i = 1, 2, . . . , rij, where T£ has failure rate f n and has distribution function H n j. Then we 



set 



X*.=min(:T*.,^) and = 1 {l* < Y£} . 
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Finally, we define F*j in the same manner as F n j, just replacing the (Xij, Ajj)'s by the 
(X*j, A*-)'s in the definition. 

Theorem 5 Suppose that (Al) and (A4) hold with L'- = fj/((l — Gj)(l — Hj)) and that 
for each j = 1,2,..., J, inf^ e roi] fj(t) > 0, Gj(l) < 1, lim^i Hj (t) < 1, and Hj has a 

bounded continuous first derivative on (0, 1). Let f n be an estimator that satisfies (A*) with 
fa = fi = ■ ■ ■ = fj, then for k = 1, the test with critical region \3ty has asymptotic level a. 

If, in addition, we assume that the censoring variables all have the same distribution func- 
tion H, then, instead of generating from distribution function H n j as above, one should 
merely generate, the bootstrap censoring times Y£ as an n-sample of independent random 
variables with common distribution function H n , the Kaplan-Meier estimator of H based on 
all n observations. With this construction of the bootstrap censoring variables we obtain a 
similar result. 

Theorem 6 Under the assumptions of Theorem^ with H = H\ = ■■■ = Hj, for k = 1,2, 
the test with critical region \32\i has asymptotic level a. 



4 Appendix 

4.1 Proof of the lemmas in Section [2] 

Proof of Lemma Because fo = fi = ■ • 
write 



fj and Ylj c j = 1> according to flU), we can 



M n0 = F n0 - F = Y^ Cj(F nj -Fj)=J2 CjM nj . 

3=1 3=1 

Since Cj = rij/n, for j = 1, 2, . . . , J, this means that 



1 3 

M n0 (t) - rr 1/2 -B n0 o Lo(t) = ~J2 n i ( M "i W 



n ■ l ^ 2 B n j o Lj(t) 



3=1 



We now have that 



P \ n^ 1/q sup 
I te[o,i] 



M n0 (t) -n- 1/2 B n0 oL (t) 



> x 



< P < n~ 1/q V rij sup 
[ te[o,i] 

J ( 



— 1/2 

M n j(u)-n rj B ri joLj(u) 



> x 



< 



3=1 



1-1/q 

n ■ sup 

te[o,i] 



— 1/2 

M nj (u) - rij B nj o Lj(tt) 



(40) 



Applying (A3) to each summand yields (|12[) for all < x < n J (mm Cj) 1+1 ^ q . Possibly enlarg- 
ing C, we obtain the result for all x G (0, n]. □ 



14 



To prove Lemma [2] for all i,j = 0, 1, . . . , J and S = E,B, W, we first need to establish two 
results on the tail probabilities of U^, that are an extension of Lemmas 3 and 4 in [9]. For 
j = 0, 1, . . . , J, let <7j denote the inverse of fj, defined for a £ R by 



gj (a)=sup{te [0,1], fj(t)>a}, 
with the convention that the supremum of an empty set is 0. 



(41) 



Lemma 7 Assume (Al), (A2) and suppose /o = /i = • • • = fj- Then, there exists C > 0, 
such that for all j = 0, 1, . . . , J, S = E, B,W, x > 0, and a £ [/j(l), fj(0)], 

C 



Vl\UZ j (a)-g j (a)\>x) < 



nx{fjo gj (a) - a) 



2 ' 



Proof: We follow the line of reasoning used in the proof of Lemma 3 in [9]. It suffices to prove 
the result for x G (0,1], since the considered probability vanishes for x > 1. Moreover, for 
simplicity, we restrict ourselves to the case a > fj(0), so that gj(a) = 0. The case a < fj(l) 
can be treated likewise. By definition of we have: 



P 



fe(a) - gj (a)\ > x) < P ( sup - au) > F^{g 3 {a)) - a 9j {a) ) . (42) 

\\u- gj (a)\>x J 



Since fj is decreasing according to (Al), we have Fj(u) — Fj(0) < ufj(0), for all u € [0, 1] 
Therefore, 

P (\U^(a) - 9j (a)\ > x) < P (sup {M^(u) - M^(0) - u(a - /,(0))} > 0^ , 



where 

M^{u) = F^{u)-F j {u). 
It then follows from Markov's inequality that 



(43) 



P [\U^{a)- gj {a)\ >x) < 



E P ( SU P i M nj( u ) ~ M nj(°)} > - /i(0)) ) 

k>l \M6[a;2 fe - 1 ,x2 fc ] / 
su P«e[x2* : - 1 ,a;2 fe ] 



fc>l 



a ,2 2 2fc-2( a _ /j ( ))2 

If we are able to show that there exists a constant C > 0, such that for all x > 0, 



E 



sup (M£(u)-M£(0))' 

x/2<«<x 



< 



n 



(44) 



then we would obtain the required result since in that case, 

Cx2 k 

k> 



¥(\U^a)- gj (a)\>x)<J2 



< 



K 



< nx 2 2 2k - 2 {a - fj{0)) 2 ~ nx(a - fj(0)) 
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It thus remains to prove (|44p for S = E,B,W. First consider j = 1,2, . . . , J. In the 
case S = E, inequality ([33]) follows from condition (A2). In the case S = W, since Lj is 



increasing, the process M^(u) = n- 



1/2 

W n j(Lj(u)) is a mean zero martingale and it follows 



from Doob's inequality, that for all x > 0: 

, 2 



E 



sup {M%(u) - M%(0)) 



.0<u<lAx 



< 4E 



Mj(lAx)-M^(0)) 



< 



Cx 



because M^(lAx)— M^(0) has a normal distribution with mean zero and variance n • 1 (Lj(lA 
x) — Lj(0)), which is bounded by nJ 1 (swp t \Lj(t)\)x. This yields (j33|) for 5 = W. In the 
case S = B, we write 

MgC*) - A^.(n) = Mj(t) - Af#(u) - n^'^L^t) - Lj(u)). 
Next, inequality Q yields: 



E 



sup (M^(u) - M^(0)Y 

0<m<1Ax 



< 



2Cx 2E[e 



+ 



iij 1 



n 



nj o<m<ia 



sup (Lj(u) - Lj(0)Y 



<2Cx + j2_/ gup |L , (t)| \ (lAx)2 _ 
n n i Ve[o,i] / 

For x > 0, we have(l A x) 2 < x, whence (03]) holds for S = B. 

Finally, consider the case j = and S = E,B, W . From (fl~9|) . (f43l) . and ([9]), we find: 



E 



sup (Mf (n)-Mf (0))' 

x/2<m<x 



J 

< j£c 2 E 



sup (M^.(«)-M^(0)) 2 



x/2<u<x 



(45) 



for all x > 0. Since g3J) holds for j = 1, 2, . . . , J and S = E,B, W, it also holds for j = 
and S = E,B,W. □ 



Lemma 8 Assume (Al), (A3) and suppose fo = fi = ■■■ = fj- Then, there exist c > and 
C > smc/i that for every j = 0, 1, . . . , J, x > and a G R, 

P (l^nj(a) - 9j(fl)\ > x )^ 2exp(-cnx 3 ), (46) 

and 

P (|t^.(a) - 5j (a)| > x) < C{nx z f-\ (47) 

/or 5 = 

Proof: We follow the line of reasoning used in the proof of Lemma 4 in [9] and assume 
x G (0,1]. Let /3 satisfy < (3 < inf t |/j(i)|/2, for every j = 1,2,... , J, which is possible 
according to (Al). From Taylor's expansion, Fj(u) — Fj(gj(a)) < (u — gj(a))a — fi{u — gj(a)) 2 , 
for all u G [0, 1], so (j32]) yields: 

P(|£%(a)-#(a)| >x) 

/ \ (48) 

< P sup {M^{u) - (<?») - P{u - 9j (a)) 2 } > . 

\\u-g 3 (a)\>x J 
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To cover all cases j = 0, 1, . . . , J simultaneously, write 

n =n and define = '{ \ ° (49) 

I snj'^ i j — 1,2, . . . , J. 

where £ n0 is denned in (07). Note that f^(t) = 0, for all j = 0, 1, . . . , n. For S = B, W, we 
have M^(u) = M^(u) - n'^f^L^u)), so that in both cases, 

P(|C%(o)-#(a)| >x) 

< P ( sup \m^(u) - M%( 9j (a)) - f (ti - 5 ») 2 ) > ] 



(50) 



1/2 



+ P f sup J (^(<7,(a))) - 4-(^-(u)) - ^-(u - 9j (a)) 2 \>0). 

\\u- gj {a)\>x [ 2 J / 

Let If be a standard two-sided Brownian motion on M. Setting v = Lj(u) — Lj( 9 j(a)), 
ko < inft|Lj(i)| and /ci > sup t \L'j(t)\ 2 , one can derive from the assumptions on Lj and 
scaling properties of W that 

P f sup (m^H - M^fe(a)) - f (ti - g 3 (a)) 2 ) > ] 

< P ( sup Lt'/VW - > o) < P ( sup > nf ^ 



\v\>k x I J 2fci J " y " yi^^fcox I M J J 2fci J 

The process {t(VF(l/u), u > 0} is distributed like {W(u), u > 0}, and the distribution of W 
is symmetric about zero. By Proposition 1.8 on page 52 in [37], we conclude that there 
exists C, K\ > depending only on Lj , such that 



(51) 



P sup (u) - M% ( 9j (a)) - ^(u - 9j {a)Y > 

\\u-g 3 (a)\>x I Z J / 

< 2P ( sup > rcf ^ < 2exp(-K 1 n/?V). 

Wfc x I « J 3 2ki J 

From (|50p . there thus exists if 2 > 0, such that 

P (\U^(a) - gj (a)\ > x) < 2exp (-Kmp 2 x 3 ) + C(j)P(|£| > ^/Sn 1 / 2 ^), 

where £ is a standard Gaussian variable, C(j) = 1 for j = 1,2, ... , J and C(0) = J. Since 
x 6 (0, 1], the latter probability is bounded from above by exp (— Kin(3 2 x 3 ) , provided K\ is 
small enough. Therefore, there exists C > with 



P (J£/J(a) -9j(a)\ >xj < 3exp (-K in f3 2 x 3 ) < C^x 3 ) 1 " 9 , 
which proves the lemma for the cases S = B, W. In the case S = E, (|48p yields 



P ( |t^-(o) - 9j(a)\ > x) < P ( sup <| Mnj(u) - M*( 9j (a)) - - 5 ») 2 |> > 

V >-<?.; (a) |>a- I 



sup |M3(u)-JM5(«)|>^- 
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where we recall that M^(u) = n- B n j(Lj(u)). From what precedes, the first probability on 
the right hand side is bounded from above by C(nx 3 ) 1-9 for some C > 0. Note that x £ (0, 1] 
and we can assume /3 < 1. In the cases j = 1, 2, . . . , J, it follows from assumption (A3) that 
there is K4 > with 

P I sup |Af£(«) - M*Av)\ > ^ I < tf^-'aT^n 1 -* < ^"'(na 3 ) 1 " 9 . 

V«6[0,l] 4 / 

From Lemma [U this inequality still holds with j = 0, which completes the proof. □ 



Proof of Lemma [2} We have 

-1 r \ r °o 



pi PI poo 



For all t € (0, 1] and a £ R, U^a) > t if and only if f^(t) > a, so the change of variable 



b = a + f^At) yields 



(/£(*)-./%(*))+ d* = / [\ rs rs dtdb 

1 







whence 



i 



(C^i(&)-C^.(6)) + d6, 

\fZ j (t)-&)\dt= I \u^{b)-u^(b)\db. 



10 

From Fubini's theorem and Lemmas [7] and [H there exists K > 0, such that for all j 
0, 1, . . . , J and 5 = £,5, W, 

00 />oo /"OO 

}S (U\ „.IU\\AU— I I to i\ttS 



E/ |C^(6)-^-(6)|d6= / / P(|C/^(6)- 5i (6)| >x)d6dx 



/•oo poo 1 
<iW / 1A — — -rdfedx 

n —l/3 I f'QO -1 

<K -= + / K db 1 dx 

Jo \V nx Ji/V^ 

fOO / 1 /"OO 



1 


+ 




yjnx 




\± 






+ 







nxb 2 



~^db 



6 2 



6Kn" 2 / 3 . 



The integral Jjf^ \U^Ab) — gj(b) \ db can be treated likewise, so we obtain 

1 rf(o) 
\f^ j (t)-&t)\dt= / \U^(b)- U^{b)\ d6 + Op(n" 2 / 3 ). 

■//(!) 
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□ 



In order to prove Lemma [SJ the line of reasoning is similar to that in [J3] , except that in 
the current situation we work in a more general model. The key result that we need is an 
extended version of Lemma 3.4 in [13], provided by the following lemma. 

■■ = fj. For j = 0,1,..., J 

(52) 



Lemma 9 Assume (Al), (A3), (A4) and suppose /o = fi 
and S = E,B,W let 

V"(a) = n) /3 (u%Aa) - 9j (a) 



and 



J, 



a./ 



f,{l) + n j 1/3 log n jt fj(0) 



-1/3 , 

n- log nj 



where uq = n. Then there exists a constant f3j > 0, independent of a £ J n j, such that 
for S = B,W and for all h G (0, 1), 



P •{ V°j jumps in [a — hn,- 1 , a + 



hn- 1/3 ) | < PjS nt h + o(5 n)h ) 



as 5n,h i 0; where 8 n h = /iV (n Q//3 (logn) a+1 ), where a € (3/4, 1] is taken from (A4)- 

Proof: We follow the line of reasoning used in the proof of Lemma 3.4 in |13j . In order to 

— 1/3 

transform the process t h-> W n j o Lj{gj{a) + n- t) into the process t h-> W n j(Lj(gj{a)) + 
n- X ^ 3 t), we define for |c| < 1, 



L*(a,c) 



n 1 / 3 [L^U^a + n 3 1/3 c)) - L 3 { gj {a))) . 



Then has a jump in (a — hn - 1 ^ 3 ,a + hn - *' 3 ) if and only if c i — >- Lj(a,c) has a jump 
in (— h, h). Then in the case S = W we have 



Lf(a, c) = argmax I W g .^{y) - p nj {c, y) } , 
yei nj (a) 1 > 



where 



I nj (a) = [n) /3 (L,(0) - Ljfaia))), n)"\L 3 {\) - L 3 ( 9j (a))) 

W tj (y) = n 1 / 6 {w nj (L 3 {t) + nj 1/3 y) - W nj {L 3 {t))) , 

with W n j, for j = 1, 2, . . . , J, being independent Brownian motions from ([ 
Brownian motion defined by (|16p . and where 



1/3/ 



(53) 



and W n o is the 



Pnj(c,y) = -nf 3 UFj o Hj) (Lj(jgj(a)) 



-1/3 

+ n j y 



F 



;(<?;("))} 



+ n 2 / 3 (a + n j 1/ 'c)\H j {L J (g j (a)) + 



-1/3 



■V3. 



«7 



(a)}, 



with ffj = Lj . To deal with the case S = B for all j = 0, 1, 2, . . . , J simultaneously, write 
B n j(t) = W n j(t) — £njW> where £^ is defined in (jMJ), and write tj = gj(a). Then, 

Lf(a,c) = argmax {B tjd (y) -p n j{c,y)} , 

yelnj (a) 
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where 

Now, to deal simultaneously with the cases S = B,W, define $JJ(c) = Lf{a, c) and 
$nj( c ) = argmax { B tjJ (y) - p nj (c - nj 1/e 'L'^tj)^ '(Lj{tj)),y) \ , 

y£l nj (a) L J 

so hat Lf(a, c) = vX(c + nT 1/6 L'^tj)^' '(Lj(tj)), for 5 = B, W. It follows that 

$nj(c) = argmax {W tj ,j(y) - <^(c,y)} , 

yel nj (a) 

with 

4(c, y) = n) /6 {4- + nj 1 ^) _ ^. j 

+ Pnj (c - n~ 1/6 'L'jitj)^' \Lj(tj)),y) . 

Suppose that the process V^- jumps in the interval (a — fan^ 1 ^ 3 , a + ■ 1 ^ 3 ). Then ip^ has a 
jump at some 

c* e {-h + nJ^L^tj^'iLjitj)), h + n-^L'^eJih^)) 

This means that if we drop the function y \- > q^j(c*,y) + /3 for varying (5 £ R onto the pro- 
cess Wtjj, it first touches Wt jt j simultaneously in two points, say (yf,wf), for i = 1,2, where 
= W tj ,j(yf) = qnj(c*,yf) + /3 5 , for some (3 s G R. Define the event = {\L?(a,c)\ < 
logrij, for all |c| < 1}. By Lemma [5] it follows that P((^4^) c ) = o{8 n ^h). Furthermore, define 
K = < n] /6 , for all j = 1,2, . . . , J}. Then, P((A'J C ) = o(J n , h ). Hence, 

P (V^ jumps in (a — hn^ 3 , a + hn 1 ^) 

< p (vg J um P s in (° - ^ 1/3 ' a + /in J 1/3 )' j4 ni n + o(5 nih ) 

and we can restrict ourselves to the event A^,nA' n . On this event, we have \yf — yf I < 2 log 



n,-. 



Next, we show that for each yf, i = 1,2, we can construct a parabola that lies above 
q^j(c*,y) + (3 s for all \y\ < lognj and that touches Wt jt j(y) at (yf,wf). To this end first 
consider the derivatives of p n j(c,y): 

With assumption (A4), we find that 

fP0A = M^l + (1 + OT -V3 )0((n -i/3 y)5) 

= jj^ + (1 + cn- 1 /3) 0((n -i/3 2/)S) + 0(m -i/3). 
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The second derivative of q^j{c,y) is 

— — — = n j £j {Ljitj) + n j y) + — ^ — 



dy 2 ' v JX JJ J dy 

1 /3 — 1 /3 

Using that p n j(c + d,y) = p n j(c, y) + dn- {Hj(Lj(tj) + n • y) — tj}, and the fact that on 



the event n vl^, one has n - (Lj(tj) + n - y)| < iCin 1 / 3 , for some ifi > only 

depending on the c/s and L/s, we conclude that on n ^4' n , 



d 2 <(c,y) _ 



l + O^-^log?!) 5 ) , 



dy 2 L'^f 

where the approximation is uniform in \y\ < lognj and |c| < 1. Therefore, there exists a 
K2 > that only depends on fj, the Cj's and Lj'a, such that on n A' n , 

0<^ S ®{! + «-^-)-}. 
for all |y| < lognj and |c| < 1. Choose M > K2 and define the parabola 



7Tnj(c, y) = 777— r-y + an.jy 2 



where 



a 



nj 2L'(t^ 2 



Then it follows that for all |y| < lognj, |c| < 1, and b G R: 

d 2 7r nj (6,y) d 2 ^(c,y) 



|l + M(n~ 1/3 log n) s j . (54) 



dy 2 dy 
Now, for each i = 1,2, choose 6, such that 



L'Atj) dy 



so that the functions ir n j{bi : y) and q^(c*,y) have the same tangent at yj. If we also take 
7i = Qnj( c * i Vi) ~ 7r nj(bi,yi) , then it follows that the parabola 7r n j(bi,y)+"fi lies above q^j(c*,y) 
and touches q^(c*,y) at y^ in such a way that they have the same tangent. This implies that 
if we drop Tr n j{bi,y) + 7, for varying 7 G R onto the process W* - j, it first touches Wt . j at yj. 
Hence, if we define 

V nj( c ) = argmax (Wt^y) - ir nj (c,y)} , 

y6/„j (a) 

then from the above construction, it follows that the process V£j has a jump in the interval 
[61,62] of maximal size \y\ — 2/2 1 ^ 2 lognj. Because 
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dq^(c,y) -1/6+8 '{t u\ , -1/3 \ , dp nj (c-n . L'^tj)^ 

^— = % {Hh) + n i V) + " ^ 



c . \f'(t 



and 

__6_ i M f[ 1/3 j n 

it follows from dq^(c*, yi)j dy = d7r n j(6j, yi)/ dy, that there exists a constant K% > 0, such 
that \bi - c*\ < K 3 \yi + 1| (n -1 / 3 log n) a , for i = 1,2. Therefore, 

|fti-c*| < K 4 ^~ Q/3 (logn) Q+1 . 

I36C3j1J.S6 

c* G (-h + nJ^L'^s/iL^)), h + n^L'^eJiL^))), 
this means that 

[6i, b 2 ] C f - + n^L'^fJiL^)) - K,nJ a/3 (log nj r +l , 

On the event A^ - n ^4' n , it follows that there exists a constant .K5 > such that [61,62] is 
contained in 

X «i = (n^L'^t^JiL^)) - K b 8 n , h ^ X/ *L' j {t j )t^\L j (t j )) + K 5 5 nA ) , 
where 5 n% h = h V (n _Q?//3 (log so that the process V^j jumps in the interval T' n j. Hence 

P [Vnj jumps in (a — hn 1 / 3 , a + /mV 3 ) ) < P [V£j jumps in Z' • ) + o(6 n h)- 



In the case S = W, we have 

p {^i jumps in X' y | = P (v^ jumps in (K 5 S njh , K 5 5 njh )^J . 
In the case S = B, because is independent of the process Wt- ,-, 

P {v^j jumps in Z^j = J P jumps in (a - K 5 5 nth , a + #5<5n,fo)} /j nj( a ) da, 

where /i ra j denotes the density of n- l ^ L'-{tj)^- {Lj{tj)). Moreover, in both cases S = W, B, 

the process Wt jt j is distributed like Brownian motion W, so the variable V^-(c) is distributed 
as 

argmax < W(y) - ° y - a nj y 2 \ , 
yel nj (a) I L jK t j) I 
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where a n j and I n j(a) are defined in (|54p and (|53|) . Since a G J nj - and the Lj's have a bounded 
first derivative, there exists Kq such that this random variable only differs from 

V nj (c) = argmax { W(y) - a nj ( y 




y£R \ 2®- n jL'j(tj j 

if | V n j (c) | > Kq log rij . Hence 

p {Vnj jumps in (a - K 5 5 n , h , a + K 5 5 n , h )} 

< P I jumps in (a - K 5 5 nth , a + K 5 5 nth ) \ + P \ sup |Kj(c)| > log nj > . 

According to Lemma 3.3(iii) in [13] the first probability is of the order 6 n h, uniformly in a. 
Finally, from the monotonicity of V n j(c) together with property (3.16) and Lemma 3.3(h) 
in }13j . it follows that the second probability is of smaller order. This proves the lemma. □ 



Lemma [9] enables us the make the transition from the empirical inverse process to the 
Brownian bridge process and establish Lemma [3l In the sequel, for x,t G R and a function 
G : R -> R, we use the notation G(t, x] = G{x) - G(t). 

Proof of Lemma [3j The proof is along the lines of the proof of Corollary 3.1 in [13]. For 

j = 0, 1, . . . , J, let 



K nj = < n 2 / 3 sup 
I te[o,i] 



M nj -(t)-n, 1/2 5 nj -(Lj(t)) 



where 5 n j = rt • 1 / 3+1 /' 3 log n and ?io = n - By condition (A3) and Lemma Q] it follows that 
¥(K n j) — > 1, as rij — > oo. Hence, we can restrict ourselves to the event K n j. Also fix 
a 6 (/,(1), /,(())) and let 

^ni = [\V*j(a)\ < n], \V?(a)\ < logn,} , where ^ - < 7 < | - -, 

(such a choice of 7 is allowed since a > 3/4 and q > 6) and write .A^ ■ = ET n j n A n j. Then by 
Lemma [5] we have 

p(^n^)<^7 37(9_1) - 

Hence, since |V^(a) - V*{a)\ < 2n/ 3 , we have for a £ (fj(l),fj(0)), 

nV${a) - V*(a)\t Kn . < E\V n E 3 (a) - ^(a)|l A , . + 2nf • ^n" 3 ^. 

The second term on the right hand side is o(ra- *' 6 ). To bound the first term, write 
nv%(a) - V%(a)\l Kj = r j P (\V$(a) - V?(a)\ > x,A' nj ) dx 

J 



+ f ^ P (|T>4(a) - Kg(a)| > dx 
< e nj + P (\V*{a) - V%{a)\ > x, A' nj ) dx, 
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where e n j = n- 1/3+7 (log rij) 2 . By definition of V^{a) for S = E,B and j = 0, 1, . . . , J, we 
have: 

Vnj(a) = argmax Z^ g , {a) (u) 

g 3 {a)+n 1/3 we[0,l] 



where 



Z^, t (u) = nf 3 {m* (t, t + Uj 1/3 u] + Fj (t, t + nj 1/3 u] - fj(t) nj 1/3 u} . (55) 

Since nf 3 \M^(t) - M^(t)\ < 5 nj on the event A' nj , we can only have \V?(a) - V^{a)\ > x, 
if 



for some u G [— n 1/3 gj(a), n^ /,:> (l — <7j(a))], such that \u — V^{a)\ > x. From here on the 
argument is identical to the one in the proof of Corollary 3.1 in [13], and it follows that 



1/3 



(o) m(a))-Z^ g . {a) (u)\<25 nj , 



nj > 



nv%{a) - V»(a)\l A ^ <e nj + j P ( \V£(a) - V%{a)\ > x, A' nj ) dx 



nj ' 



2»7 



— € nj + I P ( Vnj nas a jump in 



25 n j 26 n j 

° T/3~ ,a+ 1/3 



dx. 



According to Lemma [U] the right hand side is bounded by 

/ 2nT 1/3+1/9 log n 



e ni +/?,•(! + o(l)) 



V (V a/3 (logn) a+1 ) 



dx = o I n 



-1/6 



uniformly in a E (fj(l), fj(0)), since g > 6 and 7 < a/3 — 1/6. The lemma then follows from 
the Markov inequality. □ 



We proceed by establishing Lemmad]to make the transition to Brownian motion. For this 
we first prove that under /o = /1 = • • • = fj, standardized slopes converge in distribution to 
the slopes of the LCM of the process W(s) - s 2 + 2xs. For j = 0, 1, 2, . . . , J and S = E, B, W, 
define 

j S nj(t)=™/ 3 {fn J (t)-f J (t)}. (56) 

Then <^-(i) is the slope at s = of the LCM of the process Z% jt (s) defined in ([55]). For 
j = 0, 1, . . . , J and t £ [0, 1], define scaling constants 

2 i/3 i^L'Jt) 1 / 3 

A ' (t) = ifmv >0 and B ' ( ' ,= ^ >0 ' 

and 

I nj (t) = {u:t + nJ^Bj&u G [0, 1]} . 



24 



Lemma 10 Assume (A2), (A3). Suppose fo = f\ = f% = ■ ■ ■ = fj and for t £ (0, 1), let 

$% jtt (x) = A 3 (t)^ (t + nJ 1/3 B 3 (t)x) 

where is defined by (f56|) . Then, for S = E,B,W, and x £ (~)j = oInj(t) fixed, the vector 
(*^n0 ^ni t( x )> • • • > ®njt( x )) converges in distribution to ($>to(%), ■ ■ ■ ,^j(x)), where 



&j{x) = the slope at s = x of the LCM of the process Wj(s) — s 2 + 2xs, 



(57) 



where Wi, W2, . . . ,Wj are independent standard Brownian motions and is defined simi- 
larly with the standard Brownian motion Wto defined in (|14p . 



Proof. For j = 0, 1, . . . , J, t £ (0, 1) fixed and a,j £ R, consider the event 



< Oj ^ fnj (t + nj 1/3 Bj(t)x) < (t + n,. 1/3 Bj(t)x) + nj ^(t)- 1 ^, 



-1/3; 



-1/3 



which, according to ([22]) . is equivalent to 

Bjit)-^ 1 / 3 [G^ (fj(t + nJ 1/3 Bj(t)x) + nJ^Ajit)-^ -t}<x, (58) 
where no = n. By ([2"T]) . the left hand side of ([35]) is the argmax over u £ I n j(t) of the process 

B.W„ _1_ 77 1 . If -f _1_ 



nf 3 j M*- (t, f + ^ 1/0 J3 i (*)«J + Fj [t, t + n- L, °Bj{t)u 



fj (t + n] 1/3 B 3 (t)xj n 3 - 1/3 Bj(t)u 
A j (t)~ 1 B j (t)a j u. 



(59) 



— 1/3 

For t + n- s £ [0, 1], write 



nf 3 M%j (t, t + nj 1/3 s) = n/ 6 W nj o L,- (t, t + nj 1/3 s)] 

+ nf 3 (M% - nJ 1/2 B nj o Lj) {t, t + n" 1/3 s] 
+ ny 6 4.oL i (t,* + n7 1/3 a], 
where and no are defined in ([49 p . According to (A3) and Lemma [TJ 



sup 

t+n" 1/3 se[0,l] 



n • 



2/3 / A/f S 



-1/2 



Af£ - n, v *B nj oLi)[t,t + n 4 



-V3, 



For every j = 1, 2, . . . , J and A; > fixed, we have 



sup 

|s|<ft 



te[0,i] 



Furthermore 



7! 



1/6. 



£ n0 o L (i, i + n 1/3 s] = n 1/6 ^ c^^^Lj (t, t + n 1/3 s] . 

3=1 
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Hence, we have 



sup 

\u\<k 



J 



^ n0 oL (M + «" 1/3 «] ^^n-^VcV 2 !^! sup L'At) = o p {l) 

j i te[o,i] 



Finally, according to ([53]) . for j = 1, 2, . . . , J, 

Z n t,j(s) = nJ^W n j o Lj (t, t + nT 1/3 s )] 

= w« («] /3 (£i(* + n 7 1/3s ) - ~ w« (4(*) s ) • 

Because Brownian motion is uniformly continuous on compacta, it follows that for each j = 
1, 2, . . . , J, the process Z n j(s) converges in the uniform topology on compacta to the process 

Z t] ( S ) = L' J {t) l ' 2 W ] {s) 

where W\, W2, • • • , Wj are independent standard Brownian motions. Furthermore, for j = 0, 
according to ([53]) . we have that 

J 

Z nt , (s) = n^Wno o Lo(t, t + n" 1 /^)] = ^ c) /3 Z ntd (c) /3 s), (60) 

i=i 

which converges in distribution to the process 

J 

Zto(s) =Y, c T L 'i ( t) ll2w i(*) = L'o(t) 1/2 Wto(s), (61) 
i=i 

where Wto is defined in (|H]1 . We then conclude that for each j = 1, 2, . . . , J and S 1 = £7, B, W, 
the process in ([59]) converges in the uniform topology on compacta to the process 

L'^Bjit^Wj (u) - i|/j(t)|^(i) 2 n 2 + If^B.itfxu - A^B^a.u 
= L'jitf^Bjit) 1 / 2 {Wj{u) -u 2 + 2xu - a jU } , 

and to L'^t) 1 / 2 Bo^t) 1 / 2 {Wto(u) — u 2 + 2xu — clqu} in the case j = 0. According to Lemma 4 
in [9], together with assumptions (Al) and (A2), the argmax on the left hand side of ([58]) is 
of order O p (l). This means we can apply Theorem 2.7 from |24j . Together with the fact that 
argmaxj// (u)} = argmax { aH(u) + b} for constants a > and this yields that for each 

j = 0, 1, . . . , J, t G (0, 1) and S = E, B, W fixed, the argmax in ([58]) converges in distribution 
to Vj(x — dj/2) and v t o{x — eto/2)), respectively, where 



fj(c) = argmax { Wj(it) — (ii — c) } , j = 1, 2, . . . , J, 



^to(c) = argmax \ W t0 (u) - (u - c) 2 \ 



(62) 



To extend this to joint convergence, note that since the processes Z n tj, for j = 1, 2, . . . , J, are 
independent and Z ntj o satisfies ([60]) . they converge in distribution jointly to (Z t o, Z t \, . . . , Z t j). 
This implies joint convergence of the argmax's in (I58p : see e.g., Theorem 6.1 in [16], which 



26 



is only proven for two argmax's but which can trivially be extended to joint convergence of 
more than two. We conclude that 

P ( f] H-Wi)^) < aj ] j -+ P (f) {uj (,-|)< *} 

= P [ f| {2i/j (0) < a,} 
\j=o 

using the fact that Vj{c) — c = Uj(0), for all j = 0, 1, . . . , J and c£t. Now, let 

Dj(s, x) = left hand slope of Wj(u) — u 2 + 2xu at u = s. 

Then, similar to (I22p . one has Vj{c) < t if and only if -Dj(t, 0) < —2c, and it is straightforward 
to deduce that 2vj(c) has the same distribution as Dj(c, 0) + 4c. Furthermore, by properties 
of the LCM, one also has Dj(s,x) = Dj(s,0) + 2x. It follows that 

P m {2i/j (0) < a,}j = P m {^■(x.x) < , 

and since <&j(x) = Dj(x,x), this proves the lemma. □ 



Another ingredient to establish Lemma HI is a mixing property of the Brownian motion slope 
process. 

Lemma 11 Suppose that f = fi = ■ ■ • , fj. Then the process { (fjfc (t), f^ x (t), f^(t)) : 
t € [0, 1] } is strong mixing. More specifically, for d > 0, 

sup \F(A n B) - F(A)P(B)\ < a n {d) = de' ^ , 

where C\ % Ci > only depend on fo = fx = • • • = fj and c\, C2, . . . , cj, where the supremum 
is taken over all sets A E a{f^{s) : j = 0, 1, . . . , J, < s < t} and B G a {f^{ u ) '■ 3 = 
0, 1,... , J, t + d < u < 1}. 

Proof. Let t E (0, 1) arbitrary and take §<s\<S2<---<Sk = t<t + d = u\<U2< 
■ ■ ■ < u\ < 1. Consider events 

J 

^ = n {^m) g b ^ ■ ■ ■ > g %} > 

3=0 
J 

e * = n {©^ e c ^ • • • > ^(^) e ^} > 

3=0 

for Borel sets B±j, . . . , Sjy and Cy, . . . , C[j of R, for j = 0, 1, . . . , J. Note that cylinder sets 
of the form £?i and E?2 generate the cr-algebras A € 0"{/^(s) : j = 0, 1, . . . , J, < s < t} 
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and B G a{ f^(u) : j = 0, 1, . . . , J, t + d < u < 1}, respectively. Let CM/Z denote the least 
concave majorant of Z on the interval /. Define the event S = n/=o wnere 

={ [CM m F%] ( n ) = [CM [0 , t+< , /3] F#] («), for u G [0,t] 

and [CM [0>1] i^] (u) = [CM [t+d/2>1] F#] («), for u G [t + d, 1]}, 

where F^J is defined in (HSJ and JEJ). Let ^ = Ei n 5 and E' 2 = E 2 D S. Then J3£ 
only depends on the processes 

F rt>, F ™ » • • • » F Z before time * + d / 2 and ^2 onl y depends 
on the processes F^,F^ , . . . , after time t + d/2. Hence, since each process W n j, for 
j = 0, 1, . . . , J, is distributed like Brownian motion, it has independent increments, so that 
the events E[ and E' 2 are independent. This yields 

J 

\P{E l C\E 2 )-W{E l )W{E 2 )\ <3P(S C ) <3^P(S?). 

i=o 

Note that the concave majorants of on [0, 1] and on [0, t] coincide on [0, t] as soon as 
they coincide at the boundary points. Hence, for each j = 0, 1, . . . , J, we have that on the 
event Sj both concave majorants differ at t, which implies that they differ on the interval 

[t—drij ,t+drij ]. According to Lemma 1.3 in |30| . this happens with probability bounded 
by 8exp(— Cjnd 3 ), where the constant Cj > only depends on fj and Cj. This proves the 
lemma. □ 



Finally, we need the following result on the slopes of dependent Brownian motions with 
drift. 

Lemma 12 For i, j = 0, 1, . . . ,J, i ^ j, c> 0, and t G [0, 1] fixed, P (c^(0) = $j(0)) = 0. 
where $2 ; • • • , 3>J an d 3?o = &to Q- re defined in Lemma[W[ 

Proof: When i, j > 1, the statement is trivially true, because 3>j(0) has the same distribution 
as 2i/j(0), as defined in ()62|) . which has a bounded symmetric density according to Lemma 3.3 
in [13]. Consider the case % = and j ' > 1. Because 3>jo(0) also has the same distribution as 
2?to(0), it is equivalent to prove that c _1 ^j(0) = z?to(0) with probability zero. By Brownian 
scaling, we have that 

c -1 z/j(0) = argmax jWj(it) - c 3/2 u 2 ) 
and from (|14p it follows that 

^to(0) = argmax (ajW}(it) + aW(u) — u 2 } 

where 

a-(Tc^] 1/2 W-Wc^(Ml\ l/2 W 



J j U(*)J 
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Note that Wj and W are independent standard Brownian motions. According to [6], with 
probability one there does not exist u G M such that u is a local maximum for the process 
Xi(u) = Wj(u) — c 3 / 2 u 2 and the process -X~ 2 (u) = cijWj(u) + aW(u) — u 2 . This proves the 
lemma. □ 



Proof of Lemma |4l We follow the line of reasoning as in Corollary 3.3 in [13]. To cover all 
cases j = 0, 1, . . . , J simultaneously, first introduce 



X n j(s) 



CnjLj (s) , j — 1 , 2, . . . , J, 
£ n0 (£o(s)) ,j = 0, 



where £ nj - is defined in ©, for j = 1, 2, . . . , J, and in (fT7|) . for j = 0. Note that according 

t 1/2 

to (fT7|) . X n o(s) = 2i=i c / A n j(s). Next, for j = 0, 1, . . . , J, introduce the process 

^ J . i ( S ) = Z n B J . t ( S )+nT 1 / 6 x; i ( i ) S , 

where Z^- 1 is defined in ([55]) and no = n, and denote <#~L-(i) as the slope of the least concave 
majorant of Z^-^s) at s = 0. Then 

^(t) = ^(t) + nT 1/ X(*)- (63) 
Because Z^ t {s) = Z^ t (s) — n 1 -^ '{X n j(t + ji^- 1 ^ 3 s) — X nj -(£)}, it follows that 



7^ 



(a) = Z™ t (s) - nf (X nj (t + nj 1/3 s) - X nj (t) - nJ 1/3 X' nj (t)s) . 



Let [ti,T2] be the segment of the LCM of Z^- t that contains zero, and [r^r^] the segment 
of the LCM of Z^ t that contains zero. Define a = max(ri,r{) < and b = min(r2,T2) > 0. 
Note that we always have a < b, otherwise t\ = or r{ = 0, which is impossible by definition 
of the argmax. Then for any j = 0, 1, . . . , J, 

4-w = — — b — <i> nj (t)= a _ b , 

and 



^(t)-^(t) <nJ L " sup |A%( S )|, (64) 

se[o,i] 



uniformly in t. This means that it remains to show that 

1 - %(*)l d* = /* |%,(t) - dt + o^n- 1 / 6 ) 

o JO 
However, if we define for S = B,W and i, j = 0, 1, . . . , J, 

Xy(t) = c r 1/6 x ni (t) - c7 1/6 x ni (t), 
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where cq = 1, then according to (|63p . it is equivalent to show 

-I 



Let e > 0. Then 



n 1/6 y o {\^ j {t)+n~ 1 l«X' lj {t)\-\i,f J (t)\} dt = o p (l). 



1/6 ^ {ifgW + n" 1/f %(i)| - |$g(t)|} dt 

= n 1/6 ^ {\^(t) + n-^X[, J (t)\ - \$*(t)\) l [0 , e] (|Vg(t)|)dt 

1/6 /' {|^(*)+n- 1/8 ^-(*)| " 0g(*)|} l(«,oo)(l^(*)l)d*. 



+ n 



Because of the independence between £ nj - and B n j, and hence between X n j(t) and <^(t), the 
expectation of the first term on the right hand side is bounded from above by 

sup E|J^tol / pfe(t)| <e) dt. 
se[o,i] Jo K ' 

According to Lemma [TOl it follows that for all i,j = 0, 1, . . . , J, 



\^{t)\ < e 



)- p ( 


*i(0) 


*i(0) 




Ctl(t) 





< e 



where $0 is short for $to- By right continuity and Lemma [T2l 



limP 

<40 



$i(0) $ (0) 



Cii(i) coi(t) 



< e 



P 



$i(0) = $o(0) 
<Hi(t) c i(t) 



It follows that 

lim limsupE L 1 / 6 / +n-V^.(t)| - $g(t)|} l [0 , e] ($g(t)|)dt 

<4U n— 5>oo |_ JO 

For the remaining integral we write 

nl/ " f {\^{t)+n-^X[ {t)\ - |^(t)|} l (£:0o) (|^(t)|)dt 



0. 



l( £ ,oo)(l^(t)l) 



|^(t) + n-V6^.(t)| + |^(t)| 
2XUt)%Jt) 



|^(t) + n-V6^.(t)| + |^(t)| 
X^.(t)sign(^(t))l (e)0o) (|^g(t)|)dt + O p (n- 1 / 6 ), 



dt + O p (n- 1 / 6 ) 



using the fact that for |V^(t)| > e, 



|^g(t)+n-V6^( t )| + |^fl(t)| |^(t)| 



< 



n- 1/8 W, (*)l 



+ 0>~ 1/6 ). 
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For t E [0,1] and S = B,W, let Y$(t) = sign(^(t))l (ei0o) (|^(t)|). Then, again by indepen- 
dence of £ n j and B n j , we get 



E 



XUt)Y?(t)dt 



o 



'0<s<t<l 

for the cases j = 1,2, . . . , J and according to ([9|), 

2 J 



E[A^(s)A%.(i)]E Yg{8)Y?(t) 



ds dt, 



E[^.( s )^.(t)]Efe( s )y^(i) 



where for i,j = 1, 2, . . . , J, 
Furthermore, for all i, j = 0, 1, . . . , J, 



0<s<t<l 



ds dt, 



,1/3 



.1/3 



EY£(8)Yg{t)-EYg(8)Y™(t) < E\Y*(8)-Yg(8)\+E\Y£(t)-Yg(t)\. 
For every i G [0,1], we have 

E|y£(t) - < 2P(|$J(t) - $%{t)\ > 2e) + P(|^(f)| < e) + P(|^(i)| < e) 

Note that for all j = 0, 1, . . . , J, 



sup E\$ j (t)-<t>%(t)\ = 0(nj^)- 
*e[o,i] J 



-l/6x 



(65) 



This can be shown similar to (|64|) using that 

_ 7ff 1/6 



Z* t ( fl ) = Z5 >t («) - nf [X nj {t + nj 1/3 s) - X nj (t) 



and 



\X nj {t + rC l, %) - X nj (t + n-y z a)\ < nj 1/3 (b - a) sup |X' 

te[o,i] 



The Markov inequality together with ([55]) yields that P(|^(i) — (t)\ > 2e) tends to zero, 
uniformly in f £ [0, 1]. As before, according to Lemma [T0"| 

lim limsupP(|$g(*)| < e) = 

and likewise for P(|^(i)| < e). We conclude that for all < s < t < 1, i, j = 0, 1, . . . , J 
and e > 0, 



lim lim sup 

<40 n— >oo 



13 



0. 
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Finally, for all j = 0, 1, . . . , J, write 



E 



Y™{s)W{t) =cov(Y^(s),Y^(t))+E[Y^(s)]E[Y^(t)). 



- i.i 



W i 



Because (<Aj^(i), 4>^j(t)) is strong mixing according to Lemma [TT1 also V^J (t) is strong mixing. 



Then according to [18] (see also Lemma 3.1 in [13]), for every 0<s<t<lwe get that 



Also for every t £ (0, 1), according to Lemma [TOl writing Vq and $o fo r ^to and <&to, 



< Ke~ C2n(t ~ s) 0. 



EKf (t)) = F(i%(t) > e) - P(Vf (t) < -e) 



► P 
P 



HQ) *i(Q) 

cu(t) Aj-(t) 

2^(0) 2^(0) 

c u (t) Aj(t) 



> e 



> e 



P 

-P 



HQ) $j(Q) 

c u (f) A,-(t) 
2^(0) 2^(0) 



< -e 



< -e 



because (—1^(0), — 1^(0)) has the same distribution as (1^(0), z/j(0)). It follows that 

lim limsupE/ f XL(t)9g (t) dt\ =0. 



This proves the lemma. 



□ 



4.2 Proof of Theorems [T] and [2] 

In this section we assume that assumptions (AO), (Al), (A2), (A3), (A4) hold. Now that we 
have established Lemmas [21 [3] and [U we continue to investigate the right hand side of ([21 
i.e., integrals of the type 

n l/3 / \U%{a)-U%{a)\da. 

Jim 



We proceed as in step 2 in [9] and approximate ry ^Lj(£7,^-(a) — Lj(gj(a))j by V^(#j(a)), 
where for all j = 0, 1, . . . , J, 



|«|<logn 1 ^{L'jit))' 



V nj {t) = argmax <^ W tj (u) - TTTTTTI^'" 2 f ( 66 ) 



with Wtj the Brownian motion defined in (I53p . 

Lemma 13 There exists a C > 0, sucfo t/iat /or eac/i j = 0,1,..., J and a € + 
n-VSflogn) 2 ,/^^) - n-VSQogn) 2 ], 



E 



1/3 / r /f>W 



I L,(U^(a)) - Ljfaia))) - V nj ( 9j (a)) 



< C 



n 



-1/6 



logra 
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Proof. For j = 0, 1, . . . , J, we have 



1/3 
n 3 



( L 3@%(a)) - Lj(gj(a))j = argmax j W g . {a )j(u) - ^ + R nj( a ' u ) 



where W t j and I n j(a) are defined in (|53"|) and 



ii n j(a, it) = n^ /3 f o Lj 1 - aL- 1 j ( Lj(gj(a)) + 1/3 u 



n f 3 ( F i(9j(a)) - a gj {a)) + 2 ^^ 2 " 2 - 



Let 



^(«) = argmax I W gj{a))j {u) - ] u 2 + R nj (a, u) 

ue\- logn.lognl z \- L/ jV')) 



Since [— logn,logn] C I n j(a), we can only have nj 3 lLj(U^ (a)) — Lj(gj(a))) / U^(a), if 



7) 



1/3 



> log?i. 



Furthermore, < logn and 



whence 



E 



HU^ia^-L^a)) < sup |4(*)||E^(o) - 9j (a)\ < sup |L;.(t)|, 

te[o,i] te[o,i] 



nf (^(E^Ca)) - L;G&(a)) ) - U%(a) 



< I nj /3 sup |^(t)| +logn ] P I nV 3 sup |^(t)| U%(a)- gj (a) > logn 



,V3 



te[o,i] 



te[o,i] 



From Lemma [HI the right hand term is of the order o(n 1 / 6 /logn). This means that it 
remains to show that 

■jWi - ~ - - - - ~ n 



E 



CC(a)-^i07i(o)) 



< C- 



log n 



(67) 



It follows from the assumptions on Lj and fj that there exists K > depending only on /j 
and such that for all a £ /j(0)), 



sup 1^(0, «)| < iTn- a/3 (log 

|u|<k>gn 

By assumption, s > 3/4, so Lemma 5 from [9] yields ()67|) . 



□ 



Lemma 14 Assume f = fi 



n 1/3 [ 1 \f*M-f*(t)\dt= r 
Jo Jo 



fj. Then for every i,j = 0,l,...,J, we have 
V ni (t) V nj (t) 



L>(t)c^ L' 3 {t) Cj 



\f{t)\dt + o p {n^). 
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Proof. By assumption, L'j is bounded from below and \L"\ is bounded from above for every 
j = 0, 1, . . . , J. Moreover, integrating (|46p with gj = g the inverse of /o, one obtains that 
there exists K > depending on / and Lj only such that 

E\U%( a )-g(a)\ 2 <Kn- 2 / 3 
for every o£l. Therefore, together with a Taylor expansion, (|24p yields 

™ 1/3 /'iSw-Swid* 

JO 

°) Lift^Ca)) - Li07(a)) %(£#(a)) - L^(a)) 



1/3 



1/3 



/(I) 
/(0)-<5„ 

/(l)+5„ 



L'Ma)) 



L'Ma)) 



da + o p {n^ 6 ) 



Hm {a)) - L^a)) LjpWAa)) - L,( 5 (a)) 



L'Ma)) 



da + opin- 1 / 6 ), 



where 5 n = n 1 / 3 (logn) 2 . From Lemma [TBI together with the fact that |V^j(£)| < logn for 
every j and t, it then follows that 



n 



1/3 / \f%(t)-B(t)\dt 



/(o) 
/(i) 



Vni(g(a)) 



V n j(g(a)) 



LMa))c] /3 L'(g(a))c 



1/3 



do + o p (n~ 1/e ) 



The change of variable t = g(a) finally yields the lemma. 



□ 



From Lemma [14] we conclude that under / = f\ = fi 
statistic S n k satisfies 



fj, for k = 1,2, the test 



where 



n 1/3 S nk = / Y^dt + opin- 1 / 6 ), 



Ym(t)=J2 



J 



V ni (t) 



V nj (t) 



VAt)<h" L'Mcf 



Yn2(t) = £ 



Ko(i) Vnj(t) 



L 'S) L'mcT 



(68) 



J y '3 

Therefore, in order to prove Theorems Q] and [2l it remains to show that under f = f\ = fi 
■ ■ ■ = fj, for k = 1,2, 

,V6 



n 



Y nk (t)dt - m k 



converges in distribution to a centered Gaussian variable with a finite variance a\. To deter- 
mine m k and ai, we have to deal with joint distributions of V n i(t) and V n j(t), for different 
i,j = 0, 1, . . . , J, and with covariances between V n i(s) and V n i(t), for s and t close to each 
other. 
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We will approximate V n j(s) and V n j(t) with the variable Vtj(s) defined as follows. For all 
t 6 (0, 1) and for j = 1, 2, . . . , J, we define 

Vtj (a) = argmax J W tj (u) - J{/*L tt 2 1 , (69) 



where the process Wtj(u) is defined in (|53|) . Recall that the processes Wy, for j = 1, 2, . . . , J, 
are independent Brownian motions, whose joint distribution of (Wti, Wt2, • • • , Wtj) does not 
depend on n. Note that from (153[) it follows that 

J 

W t0 (u) = c) /3 W tj (n 1 / 3 {Lj o L^(L (t) + rT^u) - Lj(t)}) . (70) 

3=1 

Although, due to (|lip. Wto itself is distributed as standard Brownian motion, the joint dis- 
tribution of (Wto, Wti, ■ ■ ■ , Wtj) does depend on n. For this reason, we approximate Wto 
with 

^o(«) = E4 / X(c} /3 ||«), (71) 



and define 

Fto(s) = argmax \w t0 (u) - ^^y ^ \ ■ (72) 



Note that from (jlip it follows that also Wto is distributed like a standard Brownian motion, 
but this time it is a linear combination of the Wtj's not depending on n, so that the joint 
distribution of (Wto, Wti, Wt2, ■ ■ ■ , Wtj) is independent of n. The latter is important to de- 
termine an expression for the limiting variance o\ not depending on n. On the other hand, 
the approximation of V n o(t) by Vto(t) is not sufficient to replace the expectation of n 1//3 S* n 2 
by a constant m<i not depending on n. For this we will use 

F/ ( S ) = argmax \w t0 (u) - J f '}?\ 2 u 2 } , (73) 
urn I A L o( s )r J 

where Wto is from (|70p . The following lemma provides approximations of V n j (i) . 
Lemma 15 For r > 1, 

E 1/r 
E 1/r 



K,W-^(t) = o(n~ 1/6 ), forj = l,2...,J, 

(74) 



KoW-^toW 



o(n- 1/6 ) 



uniformly in t £ (0,1). Furthermore, let A > and r £ (1,2a), where a > 3/4 is taken 
from (A4)- Then, 



^W(t)-V^) =o(logn)- 1 , (75) 



uniformly in j = 0,1, J , and s,t € (0, 1), smc/i i/iai | s — 1 1 < ^4n x / 3 logn. 
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Proof: Similar to (|5ip . one can prove that there exists K\ > 0, such that for all s,t G (0, 1), 
j = 0, 1, . . . , J and x > 0, 

P(|V«(a)| > a:) < 2exp(-K 1 x 3 ), (76) 



and integrating (|76|) yields 



(77) 



for all s, i G [0, 1], j = 0, 1, . . . , J, and 7 > 0, where K2 > depends only on 7, the Lj's 
and /. To prove (|74j). first consider the cases j = 1, 2, . . . , J. By Holder's inequality we have 



E 



v nj (t)-v tj (t) 



< WE 



2r 



But, according to (JBUj) and (f6T?j) . the argmax V^j(t) can differ from Vtj(t) only if > logn, 

so from (|76|) . we obtain 



P (Ki(t) + V tj (t)j < 2exp(-iT 1 (logn) 3 ). 
Moreover, \V nj (t) - V tj (t)\ < 2\V tj (t)\. Therefore, (J77D with 7 = 2r yields 



E 



V nj (t) - V tj (t) < 2 r + 1 / 2 ^ 2 1/2 exp(-if 1 (logn) 3 /2), 



(78) 



uniformly in t G (0, 1) and j = 1, 2, . . . , J. This proves (f?4"|) for the cases j = 1, 2, . . . , J. The 
case j = in (|74p is proven completely similar. 

We proceed with proving ()75|) . From the convexity of x 1— )• x r we deduce that for all 
s,t G [0, 1] and j = 0, 1, . . . , J, 



E 



< 2 r_1 E 



(79) 



(t) - Hj (t) + 2 r " x E I Hj (t) - ^ (s) I r • 
To deal with the second term on the right-hand side of (|79|) . define the event 

A n = {\V tj (t)\ < logn, \V tj (s)\ < logn} , 
and note that from the Holder inequality, it follows that for all s, t G [0, 1], 

E \V tj (t) - V tj (s)\ r < E [\V tj (t) - V tj (s)\ r t An ] + ^E\V tj (t)-V tj (s)\ 2r P(A n ). 
Therefore, together with ([76]) and (I77p . we find 

E \V tj (t) - V tj (s)\ r < E [\V tj (t) - V tj {s)\ r t A J + K 3 exp ^-^±(logn) 3 

Since \s — t\ < A?i~ 1 / 3 logn, from (|69p and (A4) it follows that the difference between the 
drifts of the processes corresponding to Vtj(t) and Vtj(s) satisfies condition (ii) of Lemma 5 
in [9]. Since r <2a, from Lemma 5 in [9] we conclude that 



E [|Hi(^) " V tj (s)\ r t A J = E (\V tj (t) - V tj (s)\ r l|V t ,( t )|<lognl|V tj ( S )|<logn) < ^4 



J? 



-1/6 



log n 
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Hence, for all j = 0, 1, . . . , J, and s,t £ [0, 1], such that \s — t\ < An 1//3 log n, 



E 



KiW-^-(s) 



< 2 r_1 E 



K;(i)-Vy(i) 



+ 2T 5 



log ra 



(80) 



For j = 1, 2, . . . , J, the first term on the right hand side of (|8Up can be bounded together 
with (|78[) . In particular we obtain 



E 



1/r 



V nj (t)-V tj (t) =o(l/logn), 



(81) 



uniformly in t G (0,1) and j = 1,2, J. Next, consider the case j = 0. By Holder's 
inequality, for every 5 > we have 



E|Ko(i) - V t0 (t)\ r < 5 + \fW.\V n0 (t) - V t0 (t)\ 2r P(\V n0 (t) - V t0 (t)\ > 5), (82) 
where V n o(t) is defined in ([66j) . and can be written as 
V n o(t) = argmax(H / io(n) 

with 



|u|<logn 



T u 2 + R n (s,t,u) 



sup |2? n (s,t,n)| < 

|«|<logn 



l/'OOl \f'(t)\ 



2(L' (s)) 2 2 (L{,(t)) 2 



(logn) 2 + sup W t0 (u) - W m (u) 

|«|<logn 



In order to bound the probability in ()82j) . we use Proposition 1 in [8] (see also the comments 
just above this proposition), i.e., 



P(|F„o(t)- V«,(t)| >5) <P 2 sup \R n (s,t,u)\ > x5 3 ^ 2 \ + Cx\og 

I M<logn I 



(83) 



+ n\Vto(t)\ >logn), 



for 5 = n e , for some e < 1/9, and x = <5 3 / 2 n 1 / 6 (logn) 2 . From (|70f) and (I7ip . we obtain 
that for all |s — t\ < An -1 / 3 log n, 

sup \R n (s,t,u)\ < K 6 n- a / 3 (log nf + J max sup |Wfj(u) — Wtj(u)|, 



|«|<logn 



<i<J \u\< ln ,\u-v\<8 n 



where j n = K^logn and 5 n = Kjn 1//3 (logn) 2 . This means that for y > K^n a / 3 (logn) 3 , 



P sup \R n (s,t,u)\ > y < JP J sup |Wtj(«) - W t »| > 



|it|<logn 



Let M = Li^7n 1/3 (logn)~ 1 J and for k G {— M, . . . , M}, let ^ = /cn _1 / 3 (log n) 2 . Then, if 
M < 7 n , |u — u| < 5 n , it follows that |u — tk\ < re _1 / 3 (log n) 2 and \v — tk\ < 2n~ 1//3 (log n) 2 , 
for some A; G {— M, . . . , M}. This means that, together with using 



\W tj (u) - W tj (v)\ < \W tj (u) - W tj (t k )\ + |W ti (* fc ) - W tj {v)\, 
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M I 
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k=-M M"-* 



the probability on the right hand side can be bounded by 

sup \W{t k ) - W{v)\ > j-\ , 

fe |<2n-V3(iogn)2 4J ) 

where W is a standard Brownian motion. We conclude that 

Pj sup \Rn(s,t,u)\ >y j <2J(2M + 1)P ( sup |W(w)| > -p= 

\M<logn J \ | t ;|<2n- 1 /3(l ogn )2 4J 



< K 8 re 1 / 3 (logn) x exp 



(log n) 2 



(84) 



Possibly enlarging the constant Kg, this inequality still holds for all y > since for a large 
enough i^s, the right hand term becomes greater than one for y £ (0, 2i^6^ _a ^ 3 (logn) 3 ). 
Therefore, from (l83l). 



P(|Ko(i) - W)l > *) < 2exp (-K 8 (logn) 2 ) + CW^-^log n) 3 

+ 2exp(-Ki(logn) 3 ). 

Moreover, from the definitions of V n o and Vto in (f66|) and ([72]) , together with the fact that Wto 
and Wto are both distributed as standard Brownian motion, it is easy to see that E|T4).o(^)l 7 — 
!E|^4o(t)| 7 > for every 7 > 0, so it follows from (J77|) that for every 7 > 0, 

W n o(tW < WtoW = 0(1), 

uniformly in t G (0, 1). Hence, we deduce from ([82]) that (fHTj) also holds with j = 0. From ([80]) 
we then obtain 



E 1/r 



^W-VyOO =o(l/ log n) 



uniformly in j = 0, 1, . . . , J and s, t such that |s — t\ < An V 3 log n. □ 



In the following lemma, we prove that the variance of the above variable has a finite limit 
under /1 = f 2 = ■ ■ ■ = fj. 



Lemma 16 For k = 1,2, let 



v n k = var fj Y nk (t) dij . 



Under f± = fi = • • • = fj, n 1 / 3 ^^ has a finite limit o\, as n — )■ 00, where a\ is defined in 
Theorem [7] and a\ is defined in Theorem 

Proof. For k = 1,2, we have 



nl rl 

Vnk = 2 I / cov(Y nk (t),Y nk (s))dtds. 

J s 
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Note that by definition of V n j(t) in ([66]) . the random variable Y n k(t), defined in ([68]) . de- 
pends only on the increments of W n j over a neigbourhood of Lj(t) with radius of the or- 
der 0(n _1//3 log n), for j = 0,1,..., J. But for every s,t € [0,1] and j = 0,1,..., J, we 
have 

iLjW-LjWlZlt-sl inf \L' 3 {u)\, 

u£[0,lj 

where the infimum is positive according to (A3). Setting a n = An~ l l 3 \ogn, for some large 
enough A > 0, we find that Y n k(t) is independent of Y n k(s) for every \t — s\ > a n . This means 
that in for k = 1, 



Vnl 



nlA(s+a„) 



where 



2 EE 



C n ,iljm(s,t) = COV 



cov(y„ 1 (t),y ril ( s ))dtds 

1 /•lA(s+a„) 



(85) 







\f'(s)\\f'(t)\C n , iljm (s,t)dtds, 



V n i{s) V nj (s) 



1/3 



1/3 



L' z (t)c z 1/3 L' m (t)c 



1/3 



with V^j(t) defined in ([66]) . Next, we approximate both V n j(s) and Vnj-(i) with the vari- 
able V tj (s), defined in ([69]) and ([72]). According to ([75]), we have E 1 / r |y nj -(t) - V tj (s)\ r = 
o(l/ log n), uniformly in j = 0, 1, . . . , J and s,t such that |s — t\ < a n . It thus follows 
from ([85]) . together with Holder's inequality, that 



v n i 



2 EE 



1 /-lA(s+a n ) 




Js 



\f'(s)\ 2 C ilj m(s,t)dtds + oin^ 3 ), 



where 



Cil jm (s,t) = COV 



V u (s) V tj (s) 



V s i(s) V sm (s) 



1/3 



L' 4 ( S ) Cj 1/3 L^)cf 
Let dj(s) = \ f'{s)\/{2L' 3 (s) 2 ). From {69} and ([53]), we have for j = 1, 2, . . . , J, 

dj(s) 2 / 3 V tj ( S ) 

= argmax{w tj ( ^(s)" 2 / 3 ^ - dj(s)- 1/3 u 2 } 

= argmax (dj{sy 2/3 L + n| /3 (Lj-(t) - Lj(s)) dj{s) 2/3 \ ) - dj(s)- 1/3 u 2 } 
= argmax {Wj (u + n 1 / 3 (Lj{t) - Lj(s)) dj(s) 2/3 ) - u 2 } 

= argmax jt^ ^ + n x / 3 (t _ g )|/'( 5 )/2| 2 / 3 - u 2 + <(*,*,«) J 

where Wj is a standard Brownian motion and where for every \t — s\ < a n , 

sup \R' n (s,t,u)\ < sup \Wj(u) -Wj(v)\. 

|u|<logn |u|<A"logn,|M-r)|<iC'n- 1 / 3 (logn) 2 
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For j = 1, 2, . . . , J, let Q be defined by Q. We can bound tail probabilities of supi?^(s, t, u) 
similar to (|84p . Then using the same reasoning as in (|82p and ()83[) . from which we ob- 
tained (|5T|) for the case j = 0, we now conclude that for j = 1, 2, . . . , J, 



E 



2(£'(*)) 2 



2/3 



,1/3 



Vt^)-(An 1/3 (t-s)\f'(s)/2\^-^ 



L'(s) 1 / 3 



o(l/ log n), 



or equivalently 

Ms) 



E 



L'( S )cf \ci\f{s)\ 



AL'As) \ 1/3 



.1/3 



L'As) 1 / 3 



o(l/ log n). 



Change of variable t' = n 1 / 3 (t - s)|/'(s)/2| 2 / 3 , then gives 



i<j l<m 



1 raL 




GOV 



JO 



\Y sl (t') -Y sj (t%\Y sl (0) -Y sm (0)\) dt'ds + o(l), 



where a' n = Alogn|/'(s)/2| 2 / 3 and where for j = 1, 2, . . . , J, 



Ysj(t) 



L'(s) 1/3 



eft 



,1/3 sj ^^.(5)1/3 y ' 



We finish the proof for the case k = 1, by showing that there exist absolute constants if 
and if' such that 



\cov{\Y si (t)-Y sj (t)\,\Y sl (0)-Y sm {0)\) j < Kexp(-K't 3 ), 



(86) 



because then, for k = 1, the lemma follows from the dominated convergence theorem. To 
prove (f86l) . for d > 0, let 

(jd(c) = argmax {Wj(u + c) - u 2 } , (87) 

\u\<d 

define YfAt) similar to Y s j(t), with Q replaced by Cjd- If we take 



d = (t/A) min c 1 / 3 ( sup L'As 



-1/3 



i<i<J 



,s6[0,l] 



then Y£(t) - Y$(t) and 5^(0) - Y s d m (0) are independent for all i,j,l,m = 1,2,... , J and 
s 6 [0, 1], since Cjd(c) only depends on Wj(u), for u G [c— d, c+d\. Furthermore, Cjd( c ) / Cj( c ) 
if and only if | Cj C c ) I > anc ^ similar to (f76l) and ([77]) . we find that P(|(y(c)| > d) < 
2exp(-Kid 3 ) and E|Cj(c)| 7 | < K 2 , for all j = 1, 2, . . . , J, 7 > and c € K. Therefore, 
there exist Ci , C2 > such that 



and 



P(|K^)I >d) <2exp(-Cid 3 ) 



E|^(t)| 2 <E|y si (t)| 2 < min c, 2/3 sup L'-(s) 2/3 supE|G(c)| 2 < C 2 . 

i<i<^ s6[0,l] 
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By Holder's inequality, for any real valued random variables X,X',Y and Y' , we have 

\cov(X,Y) - cov(X', Y')| < E 1/2 |X| 2 E 1/2 |y - y'| 2 + E 1/2 |y'| 2 E 1/2 |X - x'\ 2 , 
and similar to (|78p . 

E\Y s i(t) - Y s d 3 (t)\ 2 < C 3 exp (-C 4 t 3 ) , 

uniformly in s £ [0, 1] and i,j = l,2,...,J. Together with (j88|) and ()89p . this proves ([86 
The proof for the case k = 2 is similar. As before, from (|75p. 

J J fl rlA(s+a n ) 

Vn2 = 2j2Y,l I \f'(s)\ 2 C l:i (s,t)dtds + o(n- 1 ^), 



i=l j=\ 







where 



and 



Cij(s, t) = cov 



E 



Fio(s) /4L' (s 



L'o(s) 



1/3 



pHf#J cH" 1/3(t - 5)l/ ' w/2|2/3 W^ 



1 2/3. 



o(l/log n). 



where (to is defined in (fl~3l) . After change of variables i' = n 1 / 3 (t — s)|/'(s)/2| 2 / 3 , we obtain 



n 1/3 w n2 = 2 ]T 



J -J /•! /-a 



JO 



cov (\Y si (t') - Y s0 (t%\Y sj (Q) - F s0 (0)|) dt'ds + o(l), 



t=i i=i 

where a' n = Alogre|/'(s)/2| 2 / 3 and 



n»w = iiwvs. (j^) , 



Similar to the reasoning above, (I86p can be shown for the case j = m = 0, so that the lemma 
follows for the case k = 2, by application of the dominated convergence theorem. □ 



We are now in position to complete the proofs of Theorems [T] and [2j 
Proof of Theorems Q] and [2j Define 

V u {t) V tj (t) 



mi 



E 



and 



m 2 := V / E 

,=i ^ 



L^) C | /3 L;(t)cJ 



!/'(*)! di, 



(90) 



(91) 
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where Vtj(t) and V/ (i) are denned in (J69]) and (|73p . From Lemma [15] we then obtain for 
k = 1,2, 

,V6 



m fc -E^ F nfe (i)d^ = o^ 1/6 ). 



Note that for j = 1, 2, . . . , J, 



~^%V t3 (t) £ (4|/'(t)|)V3^! 0(0 ) = (4|/'(t)|)V3y sj(0) , 
L s {,]r j c i 

where Cj and Y s j are defined in ([6]) and (|7|), so that 

m i = E / 1 ( 4 i/ / (*)i) 1/3E i^(°)-^(°)i d * 

7Ta Jo 



Similarly 



^^(*) = (4i/'(*)i) 1/3 4(i) 1/3 c; (o), 



where Cto ^ s defined in (fT3|) . so that 



™2 = E / ( 4 i^)i) 1/3]E L 'oW 1/3 c*o(o) - -4^- 



G(0) 



di. 



Therefore, in order to prove Theorems [T] and (2] it remains to show that, for k = 1,2, under 
fi = h = ' ' ' = fj-> 



n 



1/6 



fV nfc (t)dt-E f Y nk (t)dt 
o jo 



converges in distribution to a centered Gaussian variable with variance o\. This can be done 
using the method of big blocks and small blocks, similar to the proof of Theorem 4.1 in [131 . 
The details are omitted. □ 



4.3 Proofs for Section [3] 

Proof of Lemma [5j Since a > 3/4, we have (a + l)/(2a + 3) > 1/3. Because condition ([26]) 
holds on A n and because n _7 /e n tends to zero as n — > oo for any 7 > 0, also ([28]) holds on A n . 
To prove ([29]) on A n , let e' n = min(e n , 1/C)> where C > and e n > are taken from (A4) 
and (A*). Then, by assumption /o and f n are differentiable, in such a way that the first 
derivative has modulus of continuity w(x) < \x\ a /e' n . Then, from Proposition 2 in [43], which 
also holds with the sup-norm, it follows that there are positive constants C\ and C2, such 
that on A n , 

sup \fUt)-fo(t)\ <C 1 6"/^ + C 2 6; 1 sup \f n (t)-f (t)\ 
te[o,i] te[o,i] 

<C 1 6"/4 + C 2 6; 1 n"^/e' n , 
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where (b n ) may be any sequence tending to zero. With b n = n V( 2a + 3 ) ; it follows that on 

sup \f' n (t) - m\ < (d + C 2 )n-«l^/e' n . 
te[o,i] 

Because a > 3/4, we have a/ '(2a + 3) > 1/6 and since n~ 7 /e^ — > for any 7 > 0, condi- 
tion (|29p holds on A n . Together with (Al), under fo = fi = ■ ■ ■ = fj, this implies 

inf (-f'(t)) > ~ inf (-/n(t)) > 0. 
te[o,i] ~ 2ts[o,i] 

In particular, / n is negative on A n , so that f n is decreasing on this event. Likewise, 

sup \f' n (t)\ < 2 sup |/^)| < 00 
te[o,i] te[o,i] 

which proves (|30p and completes the proof of the lemma. □ 



Proof of Lemma [6fc With I = 0, 1, 2, the /th derivative of / n on [/i n , 1 — h n ] is given by 



ffl® 



,2+1 



F n0 (x)K«+V 



t — x 



dx. 



It follows from Lemma Q] below that 

sup \F n0 (t) - F(t) - -±=B n0 o L (t)\ = O p {n- 1+1 li), 
te[o,i] 



where F = F\ = ■ ■ ■ = Fj and Lq and B u q are defined by (jlip and (|10p . respectively. 
Combining this with the fact that ET^ +1 ) is bounded and supported on [—1,1], yields that on 
[h n , 1 - h n ], 



/in JR V V n / 



i — x 



dx + On 



11 



-1+1/9 



/J+l 
it'll 



where the O p is uniform in t € [/i n , 1 — hn]. Now, since /i„ ~ n 1 / 5 , with the change of variable 
u = it — x)/h n we obtain 



fn l) (t) = 4rr [ [F(t - uh n ) + -^=B n0 o L (t - uh n ))K^ l+1 \u) du 

+ B ( n -4/5+i/«+iM . 



(92) 



We have K^\l) = K^\—l) = 0, since K is supported on [—1, 1] and is three times continu- 
ously differentiable on R. Therefore, 



—J— [ B n0 o L (t - uh n )K^ (u) du 



< 



h n +l Vn ye[L (0),L (l)}, \x-y\<Ch 



(B n0 o L (t - ufr n ) - B n0 o L (t)) K« + V (u) du 



sup 



\B n0 (x) - B n0 (y)\ / i^ +1 )(u) 



du, 
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where C = sup t6 r 0) i] L' (t). Although B n Q is neither Brownian motion nor Brownian bridge, 
it is a linear combination of B n j, j = 1, 2, . . . , J. For this reason, using standard properties of 
Brownian motion and Brownian bridge together with the fact that h n ~ n -1 / 5 , we conclude 
that 

— |— [ B n0 o L (t - uh n )K«+V ( n ) du = O p (V 2 / 5 +</ 5 y/^) , 

where the O p is uniform in t £ [h n , 1 — Since, by assumption q > 6, together with (|92p . 
this yields 



mt) 



-L / F(t-^ n )K(' +1 )(u) d U + O p (n^/ 5+/ / 5 ybg^), 



where the O p is uniform in i € [/t n , 1 — Uniformly in t € [/i n , 1 — h n ] and u G [—1,1] we 
have 

F(t - uh n ) = F(t) - uh n f(t) + \u 2 h 2 J\t) + 0{hl). 

Since, for / = 0, 1, 2, we have J K^ l+1 \u) du = 0, we conclude that uniformly on [h n , 1 — h n ], 

fjt 
hi 



JQ)(t) = J® ( uK V +1 \u) du+^f'(t) [ u 2 K« +1 \u)du 



+ 0{h 2 - l ) + O p {n- 2 l^^g 
From our assumptions on K together with integration by parts, it follows that 

/ uK {3) (u)du = j u 2 K^\u)du = f uK {2) (u)du = [ u 2 K {l \u) du = 0. (93) 
Jm. Ju Jm. Jm 

Therefore, in the case / = 2 we obtain that f n (t) = O p {^\og n) uniformly on [h n , 1 — h n ]. 
Since f n is constant on [0, h n ] and [1 — /i n , 1], this implies that 

sup |f (£)| = O p (^). 
te[o,i] 

In particular, if A n = {sup £(E [ ^ |/A (t)\ < logn}, then P(A^) — > 1. Moreover, since f n is 
twice differentiable, (j27|) holds on A' n with s = 1 and e n = 1/logn. In the cases I = 0, 1, 
using (j93|) together with the facts that J uK^\u) du = —1 and J u 2 K^ 2 \u) du = 2, we obtain 



fg>(t) = /«(*) + 0{ht l ) + O p n- 2 ^/^. 



uniformly on [h n , 1 — h n \. Together with the definition of f n on [0, h n ] and [1 — h n , 1], we get 
that uniformly on [0, 1], 

j' n = f + O p {n~ 1 / b ^n) and /„ = / + O p (n~ 2 / 5 ^l^l). 

Therefore, if A' n = {supi e[0il] \ f n (t) - f(t)\ < n~ 2 / 5 logn}, then P(A n ) -> 1, and (J26]) holds 
on the event A'^ with s = 1 and e n = 1/logn. Setting A n = A' n n A'^ completes the proof of 
the lemma. □ 
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Sketch of proof for Theorems [3], [4], [5] and [6] That assumptions (Al),. . . ,(A4) are 
fulfilled in all the considered models is proved in [9], see her Theorems 3, 5, 6. In the 
monotone regression model, the embedding is with a Brownian motion and Lj(t) = trj; in 
the density model, the embedding is with a Brownian Bridge and Lj = Fj; in the random 
censorship model, the embedding is with a Brownian motion and 

Ht) = L (i-aJm-H^x)) dx - 

Moreover, Assumption (AO) is clearly satisfied since all the original observations are mutually 
independent, so Theorems [TJ and [2] apply in all these models and it suffices to prove that (f3T|) 
also holds under Hq. Hereafter, we assume f± = ■ ■ ■ = fj = f and /„ satisfies (A*). 

Note that, in order to prove convergence in probability, we can restrict ourselves to an 
event whose probability tends to one as n — > oo. Thus, thanks to Lemma El we assume in the 
sequel that f n is decreasing on [0, 1] and satisfies ([27]), (f28|) . ([29]) and ([30]) for some positive 
Co, Ci, s G (3/4, 1], and e n such that n _7 /e n tends to zero as n — > oo for any 7 > 0. Moreover, 
recall that a sequence of random variables X n converges in probability to a random variable 
X if, and only if, every subsequence has a further subsequence along which X n converges 
almost surely to X. Thus, in the three considered models, if a sequence of random variables, 
which is measurable with respect to the original observations, converges in probability, we can 
assume for simplicity that it converges almost surely (otherwise, argue along subsequences). 
Then, we aim to prove that almost surely, n 1 / 6 (5* fc — m^) converges in distribution to the 
Gaussian law with mean zero and variance a\. 

In each considered model, we define the bootstrap versions of / and F n j as f n and ir- 
respectively, while the bootstrap version of M n j is M*- = F*- — F n with 

F n (t)= [ f n (u)du. 
JO 

Prom what precedes, a bootstrap version of assumptions (AO) and (Al) holds (we mean that 
conditionally on the original observations, these assumptions hold with / and F n j replaced 
by their bootstrap version). Moreover, it can be proved following the line of reasonning used 
in the proof of Theorems 3,5,6 in [9], that a bootstrap version of assumptions (A2) and 
(A3) hold. The boostrap version L*- of Lj we consider in each considered model is given 
below. 

1. In the regression model, L*-{t) = trj with tJ the conditional variance of e*j. Let us 
notice that the conditional moment of order q of e*j is equal to 

n i 

E*lf*-I 9 — — \?- ■ - f-\ q 

3 i=l 

Under the assumptions of Theorem [31 we have sup t |/ n (t) — f(t)\ = o p (l) so it follows 
from the law of large numbers that ej = o p (l) for all j = 1, . . . , J. Using again the law 
of large numbers we obtain that 

maxE*|e*-| 9 = maxE|e i3 -| 9 + ojl). 

ij J ij 
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Thus, we can assume here that maxjj E*|e^| 9 < C for some positive number C that 
does not depend on n, which is the main ingredient to establish the Bootstrap version 
of (A3) in the regression model. Likewise, we can assume that r? = tJ + o(n -1 / 3 ) for 
all j = 1, ••• , J- 

2. In the density model, Lj = F n for every j. Note that / is assumed bounded from above 

and from below, so thanks to (j28|) we can assume here that f n is bounded independently 
of n from above and from below. 

3. In the random censorship model, we still can assume that f n is bounded independently 
of n from above and from below. Besides, we can assume that G n (l) < 1 — e and 
limj-j-i H n j(t) < 1 — e for some positive number e that does not depend on n, where 

G n = 1 - exp(-F n ) 

is the distribution function of the If^s. Now, the natural bootstrap version of Lj to 
consider is _ 

th ^ [ M^j dx (94) 

Jo (1-G n (x))(l-H nj (x)) 

But the maximal heigth of the jumps of H n j on [0,1) is of the order O p (l/n) and 
therefore, 

sup \H nj {t) -Hj(t)\ =Op(l/n), 

*6[0,1) 

where Hj is the continuous version of H n j (we mean, the polygonal function on [0, 1] 
that coincides with H n j at every discontinuity points of H n j on [0, 1) and such that 
Hj{l) = lim^i H n j(t)). One can then check that the bootstrap version of the embedding 
also holds with the bootstrap version of Lj defined by 

L*(t)= f - - dx 

J " Jo (1-G n (x))(l-Hj(x)) 

The advantage of this proposal as compared to (|94f) is that it has a continuous derivative 
that is bounded from below and from above. 



Finally, with the above definitions of the bootstrap versions of / and Lj , the following boot- 
strap version of (A4) clearly holds in both regression and density models: there exist an 
s G (3/4, 1] that does not depend on n such that for all x,y,j, 

\?n(x) ~ Tn(y)\ <\x- y\ s /e n and \Lf(x) - Lf(y)\ <\x- y\ s /e n . 

In the random censorship model, f' n satisfies the above Holderian assumption, but L* is 
not twice differentiable so the bootstrap version of the smoothness assumption on Lj is not 
satisfied. Instead, we have 

sup \L)'{t)-L'j{t)\ = 0p (n" 1 /3), 
te[o,i] 

where L'- is smooth. 
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Now that we have bootstrap versions of (AO),. . . ,(A4), it can be proved, following the line 
of reasoning used in the proof of Theorems Q] and [21 that 

converges in distribution to the Gaussian law with mean zero and variance cr?. This can be 
done at the price of additional difficulties which are mainly due to the facts that the bootstrap 
versions f n and L* of / and Lj depend on n, and L*- is less smooth than the original Lj in 
the random censorship model. Thus, we cannot use a Bootstrap verion of Lemma [9] in this 
model. However, here q can be chosen as large as we wish and B n j is a Brownian motion (see 
assumption (A3)), so one can avoid the use of a Bootstrap version for Lemma [9] in this model 
and directly obtain 

n 1/3 / \U^(t) - U%(t)\ dt = nV3 / pw* (a) _ uW* {a){ da + (n -i/6) 
Jo JfW 

(where as usual, U^* and U^-* are defined in the same manner as and respectively, 
just replacing the original observations with their bootstrap version in the definition), by 
using Lemma 5 in [9]. On the other hand, the presence of e n in the bootstrap version of 
(A4) does not cause any trouble thanks to the assumption that n~ 7 /e n tends to zero as 
n — > oo for any positive 7. Nevertheless, the additional difficulties are not essential so, to 
alleviate the paper, we do not provide a detailed proof for the consistancy of the bootstrap. 

It should be mentioned that the proof of Theorems Q] and [2] could be simplified if, instead 
of considering the general framework of Section (2J we restrict ourselves to one of models 
considered in Section the proof of the bootstrap version simplifies in the same manner. For 
example, in the regression model as well as in the random censoring model, the embedding in 
(A3) is with a Brownian motion B n j so the cases S = B and S = W coincide in these models; 
in particular, lemmas [TU1 [TT1 and H] are pointless and there is no need to prove a bootstrap 
version of these lemmas. On the other hand, in the monotone regression model as well as in 
the monotone density model, the processes Wto and Wto coincide since the functions L^s are 
proportional to each other, see (f70|) and ([7T]) . The proof thus simplifies a bit, and the same 
hold with its bootstrap version. 
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